[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:58 dist-test-slave-39l8 krb5kdc[20435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:58 dist-test-slave-39l8 krb5kdc[20435](info): set up 2 sockets
Aug 08 08:39:58 dist-test-slave-39l8 krb5kdc[20435](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 08:39:59.503021 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.007s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:39:59 dist-test-slave-39l8 krb5kdc[20435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:39:59.731751 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42397
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:00.193543 20452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:00.194067 20452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:00.194247 20452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:00.202769 20452 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:00.203061 20452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:00.203188 20452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:00.203356 20452 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:00.203521 20452 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:00.215842 20452 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:00.218022 20452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:00.220127 20452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:00.240047 20462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:00.240368 20463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:00.240433 20465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:00.241766 20452 server_base.cc:1034] running on GCE node
I20260808 08:40:00.243176 20452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:00.245520 20452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:00.246979 20452 hybrid_clock.cc:648] HybridClock initialized: now 1786178400246839 us; error 130 us; skew 500 ppm
I20260808 08:40:00.247661 20452 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:00 dist-test-slave-39l8 krb5kdc[20435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178400, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:00.252827 20452 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:00.256021 20452 webserver.cc:460] Webserver started at http://127.19.242.254:42291/ using document root <none> and password file <none>
I20260808 08:40:00.257330 20452 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:00.257608 20452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:00.258173 20452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:00.263113 20452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "c321f18871904fba9869ac9ac254e03f"
format_stamp: "Formatted at 2026-08-08 08:40:00 on dist-test-slave-39l8"
server_key: "7cb6a894bea01510edba360bfa4ad23a"
server_key_iv: "d272608f5a115e834665c7ff280b0464"
server_key_version: "encryptionkey@0"
I20260808 08:40:00.264235 20452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "c321f18871904fba9869ac9ac254e03f"
format_stamp: "Formatted at 2026-08-08 08:40:00 on dist-test-slave-39l8"
server_key: "7cb6a894bea01510edba360bfa4ad23a"
server_key_iv: "d272608f5a115e834665c7ff280b0464"
server_key_version: "encryptionkey@0"
I20260808 08:40:00.274012 20452 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s
I20260808 08:40:00.281029 20474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:00.283452 20452 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.001s
I20260808 08:40:00.283776 20452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "c321f18871904fba9869ac9ac254e03f"
format_stamp: "Formatted at 2026-08-08 08:40:00 on dist-test-slave-39l8"
server_key: "7cb6a894bea01510edba360bfa4ad23a"
server_key_iv: "d272608f5a115e834665c7ff280b0464"
server_key_version: "encryptionkey@0"
I20260808 08:40:00.284078 20452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:00.319129 20452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:00.328716 20452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:00.329214 20452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:00.359040 20452 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:42397
I20260808 08:40:00.359067 20547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:42397 every 8 connection(s)
I20260808 08:40:00.361618 20452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:00.368736 20548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:00.369218 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20452
I20260808 08:40:00.369625 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:00.372148 20427 external_mini_cluster.cc:1428] Setting key 569c82be948a3f3ac7901c21d060f810
I20260808 08:40:00.385305 20548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f: Bootstrap starting.
I20260808 08:40:00.391541 20548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:00.393942 20548 log.cc:824] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:00.398813 20548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f: No bootstrap required, opened a new log
Aug 08 08:40:00 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:00.409277 20548 raft_consensus.cc:348] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c321f18871904fba9869ac9ac254e03f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42397 } }
I20260808 08:40:00.409966 20548 raft_consensus.cc:374] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:00.410152 20548 raft_consensus.cc:729] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c321f18871904fba9869ac9ac254e03f, State: Initialized, Role: FOLLOWER
I20260808 08:40:00.411432 20548 consensus_queue.cc:260] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c321f18871904fba9869ac9ac254e03f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42397 } }
I20260808 08:40:00.411873 20548 raft_consensus.cc:388] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:00.412245 20548 raft_consensus.cc:482] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:00.412503 20548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:00.416509 20548 raft_consensus.cc:504] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c321f18871904fba9869ac9ac254e03f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42397 } }
I20260808 08:40:00.417749 20548 leader_election.cc:302] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c321f18871904fba9869ac9ac254e03f; no voters:
I20260808 08:40:00.418638 20548 leader_election.cc:288] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:00.418983 20555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:00.420622 20555 raft_consensus.cc:686] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [term 1 LEADER]: Becoming Leader. State: Replica: c321f18871904fba9869ac9ac254e03f, State: Running, Role: LEADER
I20260808 08:40:00.421566 20555 consensus_queue.cc:237] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c321f18871904fba9869ac9ac254e03f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42397 } }
I20260808 08:40:00.422279 20548 sys_catalog.cc:564] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:00.424944 20551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:00.378364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38304 (local address 127.19.242.254:42397)
0808 08:40:00.379830 (+ 1466us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:00.379857 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:00.381647 (+ 1790us) server_negotiation.cc:407] Connection header received
0808 08:40:00.393183 (+ 11536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:00.393221 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:00.394118 (+ 897us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:00.394756 (+ 638us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:00.398636 (+ 3880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:00.401175 (+ 2539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:00.403177 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:00.404385 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:00.404675 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:00.411449 (+ 6774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:00.411546 (+ 97us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:00.411596 (+ 50us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:00.411667 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:00.416124 (+ 4457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:00.417189 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:00.417199 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:00.417207 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:00.417555 (+ 348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:00.418119 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:00.418124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:00.418127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:00.419319 (+ 1192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:00.421470 (+ 2151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:00.421846 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 08:40:00.422611 (+ 765us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":975,"thread_start_us":526,"threads_started":1}
I20260808 08:40:00.430522 20557 sys_catalog.cc:455] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c321f18871904fba9869ac9ac254e03f. Latest consensus state: current_term: 1 leader_uuid: "c321f18871904fba9869ac9ac254e03f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c321f18871904fba9869ac9ac254e03f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42397 } } }
I20260808 08:40:00.431137 20557 sys_catalog.cc:458] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:00.433982 20556 sys_catalog.cc:455] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c321f18871904fba9869ac9ac254e03f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c321f18871904fba9869ac9ac254e03f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42397 } } }
I20260808 08:40:00.434427 20556 sys_catalog.cc:458] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:00.436918 20571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:00.444758 20571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:00.464982 20571 catalog_manager.cc:1347] Generated new cluster ID: 7b0d3c23063f4199b7a75ed0fec0e6f3
I20260808 08:40:00.465167 20571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:00.485479 20571 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:00.487701 20571 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:00.500460 20571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c321f18871904fba9869ac9ac254e03f: Generated new TSK 0
I20260808 08:40:00.502123 20571 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:00.563064 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42397
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:00.939574 20587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:00.939960 20587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:00.940198 20587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:00.948298 20587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:00.948482 20587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:00.948670 20587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:00.959326 20587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42397
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:00.960800 20587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:00.962309 20587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:00.977705 20595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:00.977843 20596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:00.977975 20598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:00.979373 20587 server_base.cc:1034] running on GCE node
I20260808 08:40:00.980187 20587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:00.981210 20587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:00.982470 20587 hybrid_clock.cc:648] HybridClock initialized: now 1786178400982399 us; error 65 us; skew 500 ppm
I20260808 08:40:00.982889 20587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:00 dist-test-slave-39l8 krb5kdc[20435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178400, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:00.986491 20587 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:00.988242 20587 webserver.cc:460] Webserver started at http://127.19.242.193:42271/ using document root <none> and password file <none>
I20260808 08:40:00.988996 20587 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:00.989112 20587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:00.989467 20587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:00.992972 20587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "5946df4f5e024866977520d3dd83f078"
format_stamp: "Formatted at 2026-08-08 08:40:00 on dist-test-slave-39l8"
server_key: "b6e7d8d6cbeab9cc96dc4fe1164cc069"
server_key_iv: "42c7083ce9aaf78d095cd56083d6b510"
server_key_version: "encryptionkey@0"
I20260808 08:40:00.993780 20587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "5946df4f5e024866977520d3dd83f078"
format_stamp: "Formatted at 2026-08-08 08:40:00 on dist-test-slave-39l8"
server_key: "b6e7d8d6cbeab9cc96dc4fe1164cc069"
server_key_iv: "42c7083ce9aaf78d095cd56083d6b510"
server_key_version: "encryptionkey@0"
I20260808 08:40:00.999580 20587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260808 08:40:01.003587 20608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:01.005198 20587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:40:01.005410 20587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "5946df4f5e024866977520d3dd83f078"
format_stamp: "Formatted at 2026-08-08 08:40:00 on dist-test-slave-39l8"
server_key: "b6e7d8d6cbeab9cc96dc4fe1164cc069"
server_key_iv: "42c7083ce9aaf78d095cd56083d6b510"
server_key_version: "encryptionkey@0"
I20260808 08:40:01.005638 20587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:01.042210 20587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:01.046690 20587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:01.047081 20587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:01.048326 20587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:01.050153 20587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:01.050232 20587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:01.050438 20587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:01.050504 20587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:01.089512 20587 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:42305
I20260808 08:40:01.089582 20778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:42305 every 8 connection(s)
I20260808 08:40:01.091068 20587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:01.099038 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20587
I20260808 08:40:01.099314 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:01.099961 20427 external_mini_cluster.cc:1428] Setting key 9ccdf2fce1c093e6bcf665cb3c66ea43
Aug 08 08:40:01 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178400, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:01.116293 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:01.094877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:44299 (local address 127.19.242.254:42397)
0808 08:40:01.095388 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:01.095393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:01.096421 (+ 1028us) server_negotiation.cc:407] Connection header received
0808 08:40:01.098497 (+ 2076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:01.098502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:01.098613 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:01.098784 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:01.100816 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.101724 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.103869 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.104691 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.104880 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:01.109409 (+ 4529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:01.109416 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:01.109419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:01.109463 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:01.112617 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:01.113592 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:01.113596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:01.113599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:01.113743 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:01.114262 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:01.114266 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:01.114268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:01.114553 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:01.114768 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:01.115625 (+ 857us) server_negotiation.cc:299] Negotiation successful
0808 08:40:01.115882 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":285,"threads_started":1}
I20260808 08:40:01.117376 20786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:01.095424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42397 (local address 127.19.242.193:44299)
0808 08:40:01.096192 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:01.096236 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:01.098096 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:01.099212 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:01.099227 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:01.099891 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:01.100602 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:01.100622 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.102007 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.102013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:01.103643 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:01.103660 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.105022 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.105028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:01.105315 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:01.106174 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:01.106211 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:01.109078 (+ 2867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:01.112822 (+ 3744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:01.112833 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:01.112857 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:01.113378 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:01.113874 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:01.113880 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:01.113884 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:01.114111 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:01.114695 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:01.114728 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:01.115143 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 08:40:01.115529 (+ 386us) client_negotiation.cc:240] Negotiation successful
0808 08:40:01.116149 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":304,"threads_started":1}
I20260808 08:40:01.119663 20779 heartbeater.cc:347] Connected to a master server at 127.19.242.254:42397
I20260808 08:40:01.120252 20779 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:01.121227 20779 heartbeater.cc:511] Master 127.19.242.254:42397 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
I20260808 08:40:01.126276 20498 ts_manager.cc:194] Registered new tserver with Master: 5946df4f5e024866977520d3dd83f078 (127.19.242.193:42305)
I20260808 08:40:01.128863 20498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:44299
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:01.151041 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42397
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:01.521027 20789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:01.521368 20789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:01.521469 20789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:01.529440 20789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:01.529577 20789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:01.529719 20789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:01.541342 20789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42397
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:01.542933 20789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:01.544366 20789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:01.559808 20794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:01.559713 20797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:01.559759 20801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:01.560990 20789 server_base.cc:1034] running on GCE node
I20260808 08:40:01.561779 20789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:01.562964 20789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:01.564199 20789 hybrid_clock.cc:648] HybridClock initialized: now 1786178401564166 us; error 68 us; skew 500 ppm
I20260808 08:40:01.564589 20789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:01 dist-test-slave-39l8 krb5kdc[20435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178401, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:01.568440 20789 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:01.570350 20789 webserver.cc:460] Webserver started at http://127.19.242.194:46861/ using document root <none> and password file <none>
I20260808 08:40:01.571255 20789 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:01.571384 20789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:01.571693 20789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:01.575263 20789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "4de5d1225e4b4e458c9319a5662f97d2"
format_stamp: "Formatted at 2026-08-08 08:40:01 on dist-test-slave-39l8"
server_key: "2a0fcbc65423bd95a105d2366e055e58"
server_key_iv: "c95cad9e27fd6fa395af92ce8c6bfe79"
server_key_version: "encryptionkey@0"
I20260808 08:40:01.576203 20789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "4de5d1225e4b4e458c9319a5662f97d2"
format_stamp: "Formatted at 2026-08-08 08:40:01 on dist-test-slave-39l8"
server_key: "2a0fcbc65423bd95a105d2366e055e58"
server_key_iv: "c95cad9e27fd6fa395af92ce8c6bfe79"
server_key_version: "encryptionkey@0"
I20260808 08:40:01.582571 20789 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 08:40:01.587435 20810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:01.589193 20789 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260808 08:40:01.589566 20789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "4de5d1225e4b4e458c9319a5662f97d2"
format_stamp: "Formatted at 2026-08-08 08:40:01 on dist-test-slave-39l8"
server_key: "2a0fcbc65423bd95a105d2366e055e58"
server_key_iv: "c95cad9e27fd6fa395af92ce8c6bfe79"
server_key_version: "encryptionkey@0"
I20260808 08:40:01.589824 20789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:01.608029 20789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:01.613559 20789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:01.613858 20789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:01.615036 20789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:01.616546 20789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:01.616650 20789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:01.616853 20789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:01.616953 20789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:01.655306 20789 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:37881
I20260808 08:40:01.655359 20964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:37881 every 8 connection(s)
I20260808 08:40:01.656816 20789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:01.664758 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20789
I20260808 08:40:01.664978 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:01.665535 20427 external_mini_cluster.cc:1428] Setting key 0025e1ec7e0997bf8b2ff81c442f7472
Aug 08 08:40:01 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178401, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:01.681493 20968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:01.659894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:55719 (local address 127.19.242.254:42397)
0808 08:40:01.660408 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:01.660413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:01.661498 (+ 1085us) server_negotiation.cc:407] Connection header received
0808 08:40:01.663493 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:01.663498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:01.663591 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:01.663700 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:01.665488 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.666486 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.668672 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.669165 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.669331 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:01.673610 (+ 4279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:01.673617 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:01.673620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:01.673665 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:01.677515 (+ 3850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:01.678471 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:01.678480 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:01.678487 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:01.678673 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:01.679197 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:01.679205 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:01.679211 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:01.679694 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:01.679867 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:01.680670 (+ 803us) server_negotiation.cc:299] Negotiation successful
0808 08:40:01.680954 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":294,"threads_started":1}
I20260808 08:40:01.682176 20969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:01.660542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42397 (local address 127.19.242.194:55719)
0808 08:40:01.661314 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:01.661354 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:01.663179 (+ 1825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:01.663944 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:01.663952 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:01.664554 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:01.665284 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:01.665305 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.666746 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.666753 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:01.668479 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:01.668497 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:01.669477 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:01.669488 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:01.669769 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:01.670579 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:01.670613 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:01.673270 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:01.677749 (+ 4479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:01.677759 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:01.677776 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:01.678289 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:01.678834 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:01.678838 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:01.678840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:01.679049 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:01.679851 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:01.679858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:01.680237 (+ 379us) client_negotiation.cc:769] Sending connection context
0808 08:40:01.680504 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 08:40:01.680966 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":294,"threads_started":1}
I20260808 08:40:01.684018 20965 heartbeater.cc:347] Connected to a master server at 127.19.242.254:42397
I20260808 08:40:01.684358 20965 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:01.685158 20965 heartbeater.cc:511] Master 127.19.242.254:42397 requested a full tablet report, sending...
I20260808 08:40:01.686865 20498 ts_manager.cc:194] Registered new tserver with Master: 4de5d1225e4b4e458c9319a5662f97d2 (127.19.242.194:37881)
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
I20260808 08:40:01.688160 20498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:55719
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:01.718019 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42397
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:02.091307 20973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:02.091712 20973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:02.091900 20973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:02.101109 20973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:02.101305 20973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:02.101514 20973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:02.112614 20973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42397
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:02.114090 20973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:02.115578 20973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:02.130630 20985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:02.130584 20982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:02.131285 20980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:02.132025 20973 server_base.cc:1034] running on GCE node
I20260808 08:40:02.132740 20973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:02.133620 20779 heartbeater.cc:503] Master 127.19.242.254:42397 was elected leader, sending a full tablet report...
I20260808 08:40:02.133941 20973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:02.135272 20973 hybrid_clock.cc:648] HybridClock initialized: now 1786178402135126 us; error 100 us; skew 500 ppm
I20260808 08:40:02.135748 20973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:02.139412 20973 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:02.141101 20973 webserver.cc:460] Webserver started at http://127.19.242.195:35399/ using document root <none> and password file <none>
I20260808 08:40:02.141966 20973 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:02.142130 20973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:02.142478 20973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:02.145751 20973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "5863b61b79b94cbcb4f374392a966e68"
format_stamp: "Formatted at 2026-08-08 08:40:02 on dist-test-slave-39l8"
server_key: "b51350dc2194e887530883d94f728d38"
server_key_iv: "01ed1ba05f52de53b04fcd5d9fe6cfea"
server_key_version: "encryptionkey@0"
I20260808 08:40:02.146612 20973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "5863b61b79b94cbcb4f374392a966e68"
format_stamp: "Formatted at 2026-08-08 08:40:02 on dist-test-slave-39l8"
server_key: "b51350dc2194e887530883d94f728d38"
server_key_iv: "01ed1ba05f52de53b04fcd5d9fe6cfea"
server_key_version: "encryptionkey@0"
I20260808 08:40:02.152747 20973 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260808 08:40:02.157047 20993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:02.158875 20973 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:40:02.159103 20973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "5863b61b79b94cbcb4f374392a966e68"
format_stamp: "Formatted at 2026-08-08 08:40:02 on dist-test-slave-39l8"
server_key: "b51350dc2194e887530883d94f728d38"
server_key_iv: "01ed1ba05f52de53b04fcd5d9fe6cfea"
server_key_version: "encryptionkey@0"
I20260808 08:40:02.159368 20973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:02.200852 20973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:02.205924 20973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:02.206354 20973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:02.207716 20973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:02.209304 20973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:02.209452 20973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:02.209623 20973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:02.209681 20973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:02.250744 20973 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:44727
I20260808 08:40:02.250864 21157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:44727 every 8 connection(s)
I20260808 08:40:02.252238 20973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:02.254004 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20973
I20260808 08:40:02.254242 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:02.254772 20427 external_mini_cluster.cc:1428] Setting key 9f397af60bbec2ad7922a9f36558a712
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:02.277226 21163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:02.255705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:40881 (local address 127.19.242.254:42397)
0808 08:40:02.256286 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:02.256293 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:02.257833 (+ 1540us) server_negotiation.cc:407] Connection header received
0808 08:40:02.260262 (+ 2429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:02.260267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:02.260356 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:02.260678 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:02.262347 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.263415 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.265266 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.265676 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.265827 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:02.270155 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:02.270163 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:02.270168 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:02.270219 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:02.273502 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.274440 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.274446 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.274452 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.274594 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.275140 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.275146 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.275149 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.275459 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:02.275654 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:02.276510 (+ 856us) server_negotiation.cc:299] Negotiation successful
0808 08:40:02.276788 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":278,"threads_started":1}
I20260808 08:40:02.278297 21164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:02.256369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42397 (local address 127.19.242.195:40881)
0808 08:40:02.257449 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:02.257528 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:02.259899 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:02.260916 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:02.260926 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:02.261505 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:02.262119 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:02.262138 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.263590 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.263594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:02.265082 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:02.265105 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.265937 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.265942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:02.266169 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:02.267001 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:02.267027 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:02.269692 (+ 2665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:02.273708 (+ 4016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:02.273719 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:02.273741 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:02.274287 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:02.274765 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:02.274770 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:02.274774 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:02.275009 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:02.275618 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:02.275627 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:02.276032 (+ 405us) client_negotiation.cc:769] Sending connection context
0808 08:40:02.276410 (+ 378us) client_negotiation.cc:240] Negotiation successful
0808 08:40:02.277048 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":408,"threads_started":1}
I20260808 08:40:02.280438 21159 heartbeater.cc:347] Connected to a master server at 127.19.242.254:42397
I20260808 08:40:02.280809 21159 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:02.281620 21159 heartbeater.cc:511] Master 127.19.242.254:42397 requested a full tablet report, sending...
I20260808 08:40:02.283430 20498 ts_manager.cc:194] Registered new tserver with Master: 5863b61b79b94cbcb4f374392a966e68 (127.19.242.195:44727)
I20260808 08:40:02.284593 20498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:40881
I20260808 08:40:02.287310 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:02.357625 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:02.339484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42104 (local address 127.19.242.193:42305)
0808 08:40:02.340278 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:02.340288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:02.340405 (+ 117us) server_negotiation.cc:407] Connection header received
0808 08:40:02.340655 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:02.340663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:02.340908 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:02.341089 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:02.342832 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.343918 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.345307 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.345922 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.346076 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:02.350692 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:02.350772 (+ 80us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:02.350797 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:02.350864 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:02.354328 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.355415 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.355426 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.355428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.355600 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.356063 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.356068 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.356070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.356469 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:02.356762 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:02.357082 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 08:40:02.357327 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":374,"threads_started":1}
W20260808 08:40:02.359397 20657 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42104
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:02.419700 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:02.403835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42114 (local address 127.19.242.193:42305)
0808 08:40:02.404109 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:02.404118 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:02.404373 (+ 255us) server_negotiation.cc:407] Connection header received
0808 08:40:02.404610 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:02.404616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:02.404702 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:02.404823 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:02.406370 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.407162 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.408466 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.409046 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.409190 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:02.413943 (+ 4753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:02.413950 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:02.413953 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:02.414001 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:02.416834 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.417624 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.417629 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.417632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.417778 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.418194 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.418200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.418204 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.418471 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:02.418782 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:02.419101 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 08:40:02.419353 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 08:40:02.421960 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20587
I20260808 08:40:02.437879 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:02.423423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42126 (local address 127.19.242.193:42305)
0808 08:40:02.423664 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:02.423670 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:02.423808 (+ 138us) server_negotiation.cc:407] Connection header received
0808 08:40:02.424063 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:02.424068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:02.424132 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:02.424241 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:02.425584 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.426304 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.427762 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.428196 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.428342 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:02.431197 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:02.431203 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:02.431206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:02.431249 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:02.434466 (+ 3217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.435668 (+ 1202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.435677 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.435699 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.435874 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.436329 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.436333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.436335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.436631 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:02.436902 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:02.437247 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 08:40:02.437495 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:40:02.439033 20774 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:02.531023 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20587
I20260808 08:40:02.559149 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20789
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:02.578414 21186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:02.560450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54846 (local address 127.19.242.194:37881)
0808 08:40:02.561087 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:02.561095 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:02.561124 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:40:02.561189 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:02.561196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:02.561418 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:02.561574 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:02.562835 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.564041 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.565465 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.566084 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.566198 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:02.570958 (+ 4760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:02.570976 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:02.570994 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:02.571051 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:02.574673 (+ 3622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.575705 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.575714 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.575717 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.575884 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.576416 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.576421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.576423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.576881 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:02.577189 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:02.577652 (+ 463us) server_negotiation.cc:299] Negotiation successful
0808 08:40:02.577905 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":307,"threads_started":1}
I20260808 08:40:02.580037 20959 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:02.667627 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20789
I20260808 08:40:02.698416 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20973
Aug 08 08:40:02 dist-test-slave-39l8 krb5kdc[20435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:02.716579 21188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:02.699662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42920 (local address 127.19.242.195:44727)
0808 08:40:02.700208 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:02.700218 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:02.700254 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:40:02.700317 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:02.700324 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:02.700553 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:02.700757 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:02.702078 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.703216 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.704542 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:02.705129 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:02.705291 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:02.710128 (+ 4837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:02.710145 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:02.710163 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:02.710217 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:02.713377 (+ 3160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.714192 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.714204 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.714207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.714369 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:02.714834 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:02.714838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:02.714841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:02.715336 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:02.715618 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:02.715975 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 08:40:02.716226 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":247,"threads_started":1}
I20260808 08:40:02.718047 21153 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:02.804576 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20973
I20260808 08:40:02.832180 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20452
I20260808 08:40:02.833503 20540 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:02.940348 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20452
2026-08-08T08:40:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4791 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:03 dist-test-slave-39l8 krb5kdc[21196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:03 dist-test-slave-39l8 krb5kdc[21196](info): set up 2 sockets
Aug 08 08:40:03 dist-test-slave-39l8 krb5kdc[21196](info): commencing operation
krb5kdc: starting...
W20260808 08:40:04.241346 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:04 dist-test-slave-39l8 krb5kdc[21196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:04.475508 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42253
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:04.832609 21221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:04.832935 21221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:04.833119 21221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:04.840721 21221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:04.840857 21221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:04.840957 21221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:04.841078 21221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:04.841167 21221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:04.852420 21221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:04.853904 21221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:04.855495 21221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:04.869216 21229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:04.869237 21228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:04.869108 21233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:04.870100 21221 server_base.cc:1034] running on GCE node
I20260808 08:40:04.871069 21221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:04.872700 21221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:04.873946 21221 hybrid_clock.cc:648] HybridClock initialized: now 1786178404873890 us; error 39 us; skew 500 ppm
I20260808 08:40:04.874404 21221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:04 dist-test-slave-39l8 krb5kdc[21196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178404, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:04.882246 21221 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:04.884308 21221 webserver.cc:460] Webserver started at http://127.19.242.254:32989/ using document root <none> and password file <none>
I20260808 08:40:04.885124 21221 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:04.885294 21221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:04.885667 21221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:04.889134 21221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "c570305f5a4d4f41a5b03c381c9f650a"
format_stamp: "Formatted at 2026-08-08 08:40:04 on dist-test-slave-39l8"
server_key: "bcc398b34d772b4453e10d1912db6c69"
server_key_iv: "1a16d7bb1de4ddf33bd49626171b27f0"
server_key_version: "encryptionkey@0"
I20260808 08:40:04.889991 21221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "c570305f5a4d4f41a5b03c381c9f650a"
format_stamp: "Formatted at 2026-08-08 08:40:04 on dist-test-slave-39l8"
server_key: "bcc398b34d772b4453e10d1912db6c69"
server_key_iv: "1a16d7bb1de4ddf33bd49626171b27f0"
server_key_version: "encryptionkey@0"
I20260808 08:40:04.897181 21221 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 08:40:04.901808 21245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:04.903450 21221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:40:04.903681 21221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "c570305f5a4d4f41a5b03c381c9f650a"
format_stamp: "Formatted at 2026-08-08 08:40:04 on dist-test-slave-39l8"
server_key: "bcc398b34d772b4453e10d1912db6c69"
server_key_iv: "1a16d7bb1de4ddf33bd49626171b27f0"
server_key_version: "encryptionkey@0"
I20260808 08:40:04.903919 21221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:04.937018 21221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:04.941902 21221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:04.942248 21221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:04.962795 21221 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:42253
I20260808 08:40:04.962797 21314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:42253 every 8 connection(s)
I20260808 08:40:04.964483 21221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:04.968768 21316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:04.969947 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21221
I20260808 08:40:04.970224 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:04.971123 20427 external_mini_cluster.cc:1428] Setting key 96e9b299675d016e79cb273338f14643
I20260808 08:40:04.985844 21316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a: Bootstrap starting.
Aug 08 08:40:04 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:04.989827 21316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:04.991092 21316 log.cc:824] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:04.994333 21316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a: No bootstrap required, opened a new log
I20260808 08:40:04.996796 21319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:04.973477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55974 (local address 127.19.242.254:42253)
0808 08:40:04.974342 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:04.974358 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:04.974405 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:40:04.976250 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:04.976279 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:04.976756 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:04.977176 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:04.979337 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:04.980678 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:04.982630 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:04.983479 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:04.983632 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:04.988696 (+ 5064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:04.988706 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:04.988724 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:04.988777 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:04.992337 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:04.993165 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:04.993174 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:04.993182 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:04.993354 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:04.993767 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:04.993772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:04.993777 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:04.994352 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:04.994689 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:04.995235 (+ 546us) server_negotiation.cc:299] Negotiation successful
0808 08:40:04.995705 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":400,"threads_started":1}
I20260808 08:40:05.002863 21316 raft_consensus.cc:348] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c570305f5a4d4f41a5b03c381c9f650a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42253 } }
I20260808 08:40:05.003324 21316 raft_consensus.cc:374] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:05.003443 21316 raft_consensus.cc:729] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c570305f5a4d4f41a5b03c381c9f650a, State: Initialized, Role: FOLLOWER
I20260808 08:40:05.004123 21316 consensus_queue.cc:260] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c570305f5a4d4f41a5b03c381c9f650a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42253 } }
I20260808 08:40:05.004437 21316 raft_consensus.cc:388] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:05.004616 21316 raft_consensus.cc:482] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:05.004803 21316 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:05.007689 21316 raft_consensus.cc:504] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c570305f5a4d4f41a5b03c381c9f650a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42253 } }
I20260808 08:40:05.008311 21316 leader_election.cc:302] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c570305f5a4d4f41a5b03c381c9f650a; no voters:
I20260808 08:40:05.009037 21316 leader_election.cc:288] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:05.009156 21322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:05.009987 21322 raft_consensus.cc:686] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [term 1 LEADER]: Becoming Leader. State: Replica: c570305f5a4d4f41a5b03c381c9f650a, State: Running, Role: LEADER
I20260808 08:40:05.010654 21322 consensus_queue.cc:237] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c570305f5a4d4f41a5b03c381c9f650a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42253 } }
I20260808 08:40:05.011529 21316 sys_catalog.cc:564] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:05.013585 21323 sys_catalog.cc:455] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c570305f5a4d4f41a5b03c381c9f650a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c570305f5a4d4f41a5b03c381c9f650a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42253 } } }
I20260808 08:40:05.013921 21323 sys_catalog.cc:458] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:05.014194 21327 sys_catalog.cc:455] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c570305f5a4d4f41a5b03c381c9f650a. Latest consensus state: current_term: 1 leader_uuid: "c570305f5a4d4f41a5b03c381c9f650a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c570305f5a4d4f41a5b03c381c9f650a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42253 } } }
I20260808 08:40:05.014540 21327 sys_catalog.cc:458] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:05.016084 21333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:05.021091 21333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:05.031082 21333 catalog_manager.cc:1347] Generated new cluster ID: 9b61553ef21248f2aa65febdd504b582
I20260808 08:40:05.031239 21333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:05.057461 21333 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:05.059020 21333 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:05.072840 21333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c570305f5a4d4f41a5b03c381c9f650a: Generated new TSK 0
I20260808 08:40:05.073832 21333 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:05.131630 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42253
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:05.507408 21354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:05.507792 21354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:05.507966 21354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:05.515976 21354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:05.516108 21354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:05.516294 21354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:05.527093 21354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42253
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:05.528532 21354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:05.529942 21354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:05.544497 21361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:05.544459 21362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:05.544567 21364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:05.545396 21354 server_base.cc:1034] running on GCE node
I20260808 08:40:05.546080 21354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:05.547259 21354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:05.548520 21354 hybrid_clock.cc:648] HybridClock initialized: now 1786178405548471 us; error 50 us; skew 500 ppm
I20260808 08:40:05.548879 21354 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:05 dist-test-slave-39l8 krb5kdc[21196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178405, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:05.552449 21354 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:05.554237 21354 webserver.cc:460] Webserver started at http://127.19.242.193:43161/ using document root <none> and password file <none>
I20260808 08:40:05.555075 21354 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:05.555188 21354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:05.555488 21354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:05.558573 21354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "f566dbd8009f4ef3b765dfd6dcf83396"
format_stamp: "Formatted at 2026-08-08 08:40:05 on dist-test-slave-39l8"
server_key: "54b5c529672bc0fcc6c29f98591b74ad"
server_key_iv: "059de474c1750b81db8a5f32e0005b6a"
server_key_version: "encryptionkey@0"
I20260808 08:40:05.559480 21354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "f566dbd8009f4ef3b765dfd6dcf83396"
format_stamp: "Formatted at 2026-08-08 08:40:05 on dist-test-slave-39l8"
server_key: "54b5c529672bc0fcc6c29f98591b74ad"
server_key_iv: "059de474c1750b81db8a5f32e0005b6a"
server_key_version: "encryptionkey@0"
I20260808 08:40:05.565902 21354 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260808 08:40:05.569949 21372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:05.571637 21354 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:40:05.571856 21354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "f566dbd8009f4ef3b765dfd6dcf83396"
format_stamp: "Formatted at 2026-08-08 08:40:05 on dist-test-slave-39l8"
server_key: "54b5c529672bc0fcc6c29f98591b74ad"
server_key_iv: "059de474c1750b81db8a5f32e0005b6a"
server_key_version: "encryptionkey@0"
I20260808 08:40:05.572104 21354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:05.597409 21354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:05.602481 21354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:05.602886 21354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:05.604055 21354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:05.605621 21354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:05.605733 21354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:05.605903 21354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:05.605980 21354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:05.641813 21354 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:46087
I20260808 08:40:05.641865 21533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:46087 every 8 connection(s)
I20260808 08:40:05.643317 21354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:05.646440 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21354
I20260808 08:40:05.646680 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:05.647578 20427 external_mini_cluster.cc:1428] Setting key 7e9fef034d01ead6ece8b5b273315e87
Aug 08 08:40:05 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178405, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:05.666575 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:05.646306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:47383 (local address 127.19.242.254:42253)
0808 08:40:05.646852 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:05.646856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:05.648096 (+ 1240us) server_negotiation.cc:407] Connection header received
0808 08:40:05.650290 (+ 2194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:05.650296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:05.650398 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:05.650523 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:05.652200 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:05.652941 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:05.654563 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:05.655047 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:05.655192 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:05.659561 (+ 4369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:05.659567 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:05.659570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:05.659606 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:05.662414 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:05.663388 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:05.663393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:05.663395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:05.663531 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:05.664155 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:05.664164 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:05.664171 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:05.664665 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:05.664865 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:05.665706 (+ 841us) server_negotiation.cc:299] Negotiation successful
0808 08:40:05.666016 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":283,"threads_started":1}
I20260808 08:40:05.667341 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:05.647068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42253 (local address 127.19.242.193:47383)
0808 08:40:05.647922 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:05.647964 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:05.649993 (+ 2029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:05.650843 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:05.650852 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:05.651402 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:05.652020 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:05.652039 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:05.653125 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:05.653129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:05.654393 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:05.654407 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:05.655326 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:05.655334 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:05.655597 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:05.656390 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:05.656429 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:05.659283 (+ 2854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:05.662600 (+ 3317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:05.662610 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:05.662630 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:05.663192 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:05.663660 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:05.663665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:05.663669 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:05.663962 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:05.664845 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:05.664853 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:05.665235 (+ 382us) client_negotiation.cc:769] Sending connection context
0808 08:40:05.665487 (+ 252us) client_negotiation.cc:240] Negotiation successful
0808 08:40:05.665935 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":366,"threads_started":1}
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
I20260808 08:40:05.669129 21534 heartbeater.cc:347] Connected to a master server at 127.19.242.254:42253
I20260808 08:40:05.669483 21534 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:05.670279 21534 heartbeater.cc:511] Master 127.19.242.254:42253 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
I20260808 08:40:05.672657 21271 ts_manager.cc:194] Registered new tserver with Master: f566dbd8009f4ef3b765dfd6dcf83396 (127.19.242.193:46087)
I20260808 08:40:05.674175 21271 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:47383
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:05.698630 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42253
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:06.056244 21541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:06.056617 21541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:06.056818 21541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:06.064548 21541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:06.064739 21541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:06.064939 21541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:06.075677 21541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42253
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:06.077280 21541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:06.078853 21541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:06.095216 21547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:06.095155 21550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:06.095151 21548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:06.100977 21541 server_base.cc:1034] running on GCE node
I20260808 08:40:06.101814 21541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:06.103061 21541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:06.104329 21541 hybrid_clock.cc:648] HybridClock initialized: now 1786178406104248 us; error 67 us; skew 500 ppm
I20260808 08:40:06.104760 21541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:06 dist-test-slave-39l8 krb5kdc[21196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178406, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:06.108973 21541 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:06.111169 21541 webserver.cc:460] Webserver started at http://127.19.242.194:43113/ using document root <none> and password file <none>
I20260808 08:40:06.112154 21541 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:06.112334 21541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:06.112722 21541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:06.116369 21541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "dae0209d830d437b83370f421d2bdc06"
format_stamp: "Formatted at 2026-08-08 08:40:06 on dist-test-slave-39l8"
server_key: "40ad36e9b456fa375f2c11b9bfdeb3c2"
server_key_iv: "b3865f5c1884f9b4f5b47cc8f201bd0c"
server_key_version: "encryptionkey@0"
I20260808 08:40:06.117349 21541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "dae0209d830d437b83370f421d2bdc06"
format_stamp: "Formatted at 2026-08-08 08:40:06 on dist-test-slave-39l8"
server_key: "40ad36e9b456fa375f2c11b9bfdeb3c2"
server_key_iv: "b3865f5c1884f9b4f5b47cc8f201bd0c"
server_key_version: "encryptionkey@0"
I20260808 08:40:06.124228 21541 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 08:40:06.128505 21558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:06.130271 21541 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:40:06.130537 21541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "dae0209d830d437b83370f421d2bdc06"
format_stamp: "Formatted at 2026-08-08 08:40:06 on dist-test-slave-39l8"
server_key: "40ad36e9b456fa375f2c11b9bfdeb3c2"
server_key_iv: "b3865f5c1884f9b4f5b47cc8f201bd0c"
server_key_version: "encryptionkey@0"
I20260808 08:40:06.130923 21541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:06.154985 21541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:06.160115 21541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:06.160467 21541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:06.161666 21541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:06.163295 21541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:06.163444 21541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:06.163602 21541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:06.163686 21541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:06.201069 21541 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45783
I20260808 08:40:06.201188 21726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45783 every 8 connection(s)
I20260808 08:40:06.202498 21541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:06.203214 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21541
I20260808 08:40:06.203487 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:06.204154 20427 external_mini_cluster.cc:1428] Setting key 6a871cc39e7cd01d75063b9395f499e8
Aug 08 08:40:06 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178406, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
I20260808 08:40:06.228531 21729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.205713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:34031 (local address 127.19.242.254:42253)
0808 08:40:06.206196 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:06.206202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:06.207497 (+ 1295us) server_negotiation.cc:407] Connection header received
0808 08:40:06.210853 (+ 3356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:06.210858 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:06.210934 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:06.211042 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:06.213558 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.214329 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.216231 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.216657 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.216773 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.221334 (+ 4561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:06.221340 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:06.221343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:06.221383 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:06.224727 (+ 3344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:06.225612 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:06.225617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:06.225620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:06.225766 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:06.226280 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:06.226285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:06.226287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:06.226588 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:06.226814 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:06.227681 (+ 867us) server_negotiation.cc:299] Negotiation successful
0808 08:40:06.227939 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":232,"threads_started":1}
I20260808 08:40:06.229770 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.206345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42253 (local address 127.19.242.194:34031)
0808 08:40:06.207307 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:06.207379 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:06.210388 (+ 3009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:06.211428 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:06.211443 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:06.212396 (+ 953us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:06.213322 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.213355 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.214536 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.214543 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.216050 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.216070 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.216927 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.216937 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.217309 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.218126 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:06.218168 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:06.221040 (+ 2872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:06.224910 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:06.224921 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:06.224943 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:06.225453 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:06.225896 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:06.225902 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:06.225905 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:06.226127 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:06.226794 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:06.226803 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:06.227225 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 08:40:06.227570 (+ 345us) client_negotiation.cc:240] Negotiation successful
0808 08:40:06.228201 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":338,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
I20260808 08:40:06.231666 21727 heartbeater.cc:347] Connected to a master server at 127.19.242.254:42253
I20260808 08:40:06.232070 21727 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:06.233103 21727 heartbeater.cc:511] Master 127.19.242.254:42253 requested a full tablet report, sending...
I20260808 08:40:06.235162 21271 ts_manager.cc:194] Registered new tserver with Master: dae0209d830d437b83370f421d2bdc06 (127.19.242.194:45783)
I20260808 08:40:06.236224 21271 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:34031
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:06.258898 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42253
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:06.630304 21733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:06.630873 21733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:06.631067 21733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:06.639851 21733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:06.639997 21733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:06.640136 21733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:06.651763 21733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:42253
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:06.653127 21733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:06.654485 21733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:06.669059 21745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:06.669010 21744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:06.669090 21747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:06.670230 21733 server_base.cc:1034] running on GCE node
I20260808 08:40:06.671126 21733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:06.672298 21733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:06.673581 21733 hybrid_clock.cc:648] HybridClock initialized: now 1786178406673523 us; error 62 us; skew 500 ppm
I20260808 08:40:06.673987 21733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:06 dist-test-slave-39l8 krb5kdc[21196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178406, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:06.677724 21534 heartbeater.cc:503] Master 127.19.242.254:42253 was elected leader, sending a full tablet report...
I20260808 08:40:06.677898 21733 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:06.680217 21733 webserver.cc:460] Webserver started at http://127.19.242.195:45231/ using document root <none> and password file <none>
I20260808 08:40:06.681043 21733 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:06.681216 21733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:06.681612 21733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:06.685075 21733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "850ef18ae14f45cdbc86485be6a9da0a"
format_stamp: "Formatted at 2026-08-08 08:40:06 on dist-test-slave-39l8"
server_key: "86bba2e29ecd0632a0ab186411ad7bac"
server_key_iv: "894b2d044dd50f10a319b677234bb7e0"
server_key_version: "encryptionkey@0"
I20260808 08:40:06.686048 21733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "850ef18ae14f45cdbc86485be6a9da0a"
format_stamp: "Formatted at 2026-08-08 08:40:06 on dist-test-slave-39l8"
server_key: "86bba2e29ecd0632a0ab186411ad7bac"
server_key_iv: "894b2d044dd50f10a319b677234bb7e0"
server_key_version: "encryptionkey@0"
I20260808 08:40:06.692196 21733 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260808 08:40:06.696487 21755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:06.698035 21733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:40:06.698269 21733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "850ef18ae14f45cdbc86485be6a9da0a"
format_stamp: "Formatted at 2026-08-08 08:40:06 on dist-test-slave-39l8"
server_key: "86bba2e29ecd0632a0ab186411ad7bac"
server_key_iv: "894b2d044dd50f10a319b677234bb7e0"
server_key_version: "encryptionkey@0"
I20260808 08:40:06.698525 21733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:06.735400 21733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:06.740309 21733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:06.740672 21733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:06.741813 21733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:06.743515 21733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:06.743657 21733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:06.743814 21733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:06.743891 21733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:06.781666 21733 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:43607
I20260808 08:40:06.781706 21906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:43607 every 8 connection(s)
I20260808 08:40:06.783267 21733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:06.784536 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21733
I20260808 08:40:06.784773 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:06.785326 20427 external_mini_cluster.cc:1428] Setting key ac9188c8b4e72c188a81324e3b875186
Aug 08 08:40:06 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178406, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:06.810411 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.786632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:37171 (local address 127.19.242.254:42253)
0808 08:40:06.787210 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:06.787217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:06.789897 (+ 2680us) server_negotiation.cc:407] Connection header received
0808 08:40:06.792158 (+ 2261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:06.792163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:06.792260 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:06.792370 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:06.794209 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.795173 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.796992 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.797455 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.797617 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.802288 (+ 4671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:06.802294 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:06.802297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:06.802336 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:06.806478 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:06.807719 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:06.807725 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:06.807727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:06.807872 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:06.808494 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:06.808498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:06.808500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:06.808897 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:06.809032 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:06.809901 (+ 869us) server_negotiation.cc:299] Negotiation successful
0808 08:40:06.810115 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":318,"threads_started":1}
I20260808 08:40:06.811794 21912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.787443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42253 (local address 127.19.242.195:37171)
0808 08:40:06.789676 (+ 2233us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:06.789744 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:06.791792 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:06.792652 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:06.792662 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:06.793332 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:06.793982 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.794001 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.795378 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.795383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.796813 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.796828 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.797760 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.797765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.797996 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.798953 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:06.798980 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:06.801983 (+ 3003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:06.806687 (+ 4704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:06.806697 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:06.806766 (+ 69us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:06.807580 (+ 814us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:06.807994 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:06.807998 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:06.808000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:06.808314 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:06.809052 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:06.809059 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:06.809481 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 08:40:06.809766 (+ 285us) client_negotiation.cc:240] Negotiation successful
0808 08:40:06.810282 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1916,"thread_start_us":1640,"threads_started":1}
I20260808 08:40:06.813712 21907 heartbeater.cc:347] Connected to a master server at 127.19.242.254:42253
I20260808 08:40:06.814122 21907 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:06.815189 21907 heartbeater.cc:511] Master 127.19.242.254:42253 requested a full tablet report, sending...
I20260808 08:40:06.816828 21271 ts_manager.cc:194] Registered new tserver with Master: 850ef18ae14f45cdbc86485be6a9da0a (127.19.242.195:43607)
I20260808 08:40:06.817734 21271 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:37171
I20260808 08:40:06.828792 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:40:06.852313 21910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.836916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55978 (local address 127.19.242.254:42253)
0808 08:40:06.837191 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:06.837199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:06.837577 (+ 378us) server_negotiation.cc:407] Connection header received
0808 08:40:06.837721 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:06.837726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:06.837800 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:06.837899 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:06.839700 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.840508 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.841915 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.842353 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.842469 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.845444 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:06.845450 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:06.845453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:06.845497 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:06.848979 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:06.849839 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:06.849845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:06.849848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:06.850001 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:06.850473 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:06.850477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:06.850479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:06.850948 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:06.851203 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:06.851650 (+ 447us) server_negotiation.cc:299] Negotiation successful
0808 08:40:06.851864 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 08:40:06.862097 21271 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:06.871809 21271 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:06.915427 21928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.890428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43522 (local address 127.19.242.195:43607)
0808 08:40:06.906156 (+ 15728us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:06.906171 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:06.906231 (+ 60us) server_negotiation.cc:407] Connection header received
0808 08:40:06.906387 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:06.906400 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:06.906811 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:06.907106 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:06.907941 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.909776 (+ 1835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.912449 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.914032 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.914276 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.914516 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:06.914855 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 08:40:06.915035 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15430,"thread_start_us":16692,"threads_started":1}
I20260808 08:40:06.915542 21927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.890174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:43607 (local address 127.0.0.1:43522)
0808 08:40:06.891056 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:06.891107 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:06.891356 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:06.907191 (+ 15835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:06.907200 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:06.907243 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:06.907691 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.907707 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.909951 (+ 2244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.909956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.912207 (+ 2251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.912226 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.914282 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.914289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.914513 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.914576 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 08:40:06.914786 (+ 210us) client_negotiation.cc:240] Negotiation successful
0808 08:40:06.915009 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"mutex_wait_us":6,"thread_start_us":380,"threads_started":1}
I20260808 08:40:06.917174 21930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.891536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:46087 (local address 127.0.0.1:49234)
0808 08:40:06.905404 (+ 13868us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:06.905443 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:06.905658 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:06.907860 (+ 2202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:06.907869 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:06.907908 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:06.909108 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.909121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.910901 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.910909 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.913239 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.913255 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.916301 (+ 3046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.916308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.916506 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.916543 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:40:06.916640 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:40:06.916789 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13643,"thread_start_us":14245,"threads_started":1}
I20260808 08:40:06.918115 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.892323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49234 (local address 127.19.242.193:46087)
0808 08:40:06.907181 (+ 14858us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:06.907189 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:06.907218 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:40:06.907321 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:06.907328 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:06.907625 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:06.907864 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:06.909368 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.910683 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.913477 (+ 2794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.915335 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.915549 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.916126 (+ 577us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:06.917555 (+ 1429us) server_negotiation.cc:299] Negotiation successful
0808 08:40:06.917753 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14681,"thread_start_us":14504,"threads_started":1}
I20260808 08:40:06.919507 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.891853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45783 (local address 127.0.0.1:52928)
0808 08:40:06.908742 (+ 16889us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:06.908770 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:06.908896 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:06.909965 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:06.909969 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:06.910006 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:06.910499 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.910512 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.912730 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.912743 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.915165 (+ 2422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:06.915183 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.918575 (+ 3392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.918582 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:06.918803 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.918836 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:40:06.918942 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:40:06.919091 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16726,"mutex_wait_us":25,"thread_start_us":16454,"threads_started":1}
I20260808 08:40:06.919528 21934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:06.892899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52928 (local address 127.19.242.194:45783)
0808 08:40:06.906555 (+ 13656us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:06.906564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:06.908992 (+ 2428us) server_negotiation.cc:407] Connection header received
0808 08:40:06.909106 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:06.909112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:06.909373 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:06.909578 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:06.910733 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.912526 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.915419 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:06.917820 (+ 2401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:06.918012 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:06.918395 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:06.919011 (+ 616us) server_negotiation.cc:299] Negotiation successful
0808 08:40:06.919191 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13466,"thread_start_us":13312,"threads_started":1}
I20260808 08:40:06.920814 21818 tablet_service.cc:1467] Processing CreateTablet for tablet 53fa4db332d046c48e1e2c0d6c75a6ad (DEFAULT_TABLE table=test-table [id=7a99a9d5eae243cbad740237e9178367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:06.922585 21818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53fa4db332d046c48e1e2c0d6c75a6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:06.922119 21444 tablet_service.cc:1467] Processing CreateTablet for tablet 53fa4db332d046c48e1e2c0d6c75a6ad (DEFAULT_TABLE table=test-table [id=7a99a9d5eae243cbad740237e9178367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:06.923825 21444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53fa4db332d046c48e1e2c0d6c75a6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:06.924105 21632 tablet_service.cc:1467] Processing CreateTablet for tablet 53fa4db332d046c48e1e2c0d6c75a6ad (DEFAULT_TABLE table=test-table [id=7a99a9d5eae243cbad740237e9178367]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:06.925705 21632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53fa4db332d046c48e1e2c0d6c75a6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:06.938208 21935 tablet_bootstrap.cc:492] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a: Bootstrap starting.
I20260808 08:40:06.941421 21937 tablet_bootstrap.cc:492] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06: Bootstrap starting.
I20260808 08:40:06.942059 21935 tablet_bootstrap.cc:654] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:06.943475 21936 tablet_bootstrap.cc:492] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396: Bootstrap starting.
I20260808 08:40:06.943553 21935 log.cc:824] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:06.946017 21937 tablet_bootstrap.cc:654] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:06.947347 21936 tablet_bootstrap.cc:654] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:06.947538 21937 log.cc:824] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:06.947728 21935 tablet_bootstrap.cc:492] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a: No bootstrap required, opened a new log
I20260808 08:40:06.948035 21935 ts_tablet_manager.cc:1397] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 08:40:06.948752 21936 log.cc:824] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:06.951491 21937 tablet_bootstrap.cc:492] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06: No bootstrap required, opened a new log
I20260808 08:40:06.951799 21937 ts_tablet_manager.cc:1397] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 08:40:06.953043 21936 tablet_bootstrap.cc:492] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396: No bootstrap required, opened a new log
I20260808 08:40:06.953342 21936 ts_tablet_manager.cc:1397] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260808 08:40:06.959717 21935 raft_consensus.cc:348] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:06.960258 21935 raft_consensus.cc:374] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:06.960368 21935 raft_consensus.cc:729] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850ef18ae14f45cdbc86485be6a9da0a, State: Initialized, Role: FOLLOWER
I20260808 08:40:06.961069 21935 consensus_queue.cc:260] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:06.962452 21907 heartbeater.cc:503] Master 127.19.242.254:42253 was elected leader, sending a full tablet report...
I20260808 08:40:06.961779 21936 raft_consensus.cc:348] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:06.963121 21936 raft_consensus.cc:374] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:06.963269 21936 raft_consensus.cc:729] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f566dbd8009f4ef3b765dfd6dcf83396, State: Initialized, Role: FOLLOWER
I20260808 08:40:06.963325 21935 ts_tablet_manager.cc:1428] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260808 08:40:06.964006 21936 consensus_queue.cc:260] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:06.964475 21937 raft_consensus.cc:348] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:06.964938 21937 raft_consensus.cc:374] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:06.965070 21937 raft_consensus.cc:729] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dae0209d830d437b83370f421d2bdc06, State: Initialized, Role: FOLLOWER
I20260808 08:40:06.965931 21937 consensus_queue.cc:260] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:06.973881 21936 ts_tablet_manager.cc:1428] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396: Time spent starting tablet: real 0.020s user 0.013s sys 0.006s
I20260808 08:40:06.974570 21937 ts_tablet_manager.cc:1428] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06: Time spent starting tablet: real 0.023s user 0.013s sys 0.007s
I20260808 08:40:06.974726 21727 heartbeater.cc:503] Master 127.19.242.254:42253 was elected leader, sending a full tablet report...
W20260808 08:40:07.035549 21908 tablet.cc:2369] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:40:07.146340 21535 tablet.cc:2369] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:40:07.205384 21728 tablet.cc:2369] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:40:07.288733 21943 raft_consensus.cc:482] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:07.289090 21943 raft_consensus.cc:504] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:07.291491 21943 leader_election.cc:288] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 850ef18ae14f45cdbc86485be6a9da0a (127.19.242.195:43607), dae0209d830d437b83370f421d2bdc06 (127.19.242.194:45783)
I20260808 08:40:07.298570 21928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.292050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:47785 (local address 127.19.242.195:43607)
0808 08:40:07.292335 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.292345 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.292953 (+ 608us) server_negotiation.cc:407] Connection header received
0808 08:40:07.293191 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.293195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.293259 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.293369 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:07.293999 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.294790 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.296749 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.297551 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.297759 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.297843 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.298149 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.298285 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260808 08:40:07.299005 21946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.291772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:43607 (local address 127.19.242.193:47785)
0808 08:40:07.292826 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:07.292844 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:07.293042 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:07.293388 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:07.293392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:07.293418 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:07.293840 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:07.293850 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.294918 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.294926 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:07.296562 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:07.296576 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.297782 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.297789 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:07.297954 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.297978 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:40:07.298121 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 08:40:07.298283 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":38,"thread_start_us":753,"threads_started":1}
I20260808 08:40:07.299129 21934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.292128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:43107 (local address 127.19.242.194:45783)
0808 08:40:07.292515 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.292521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.293059 (+ 538us) server_negotiation.cc:407] Connection header received
0808 08:40:07.293276 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.293281 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.293348 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.293463 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:07.294172 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.295045 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.297106 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.298016 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.298218 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.298310 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.298653 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.298835 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241}
I20260808 08:40:07.299268 21945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.291865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45783 (local address 127.19.242.193:43107)
0808 08:40:07.292934 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:07.292955 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:07.293085 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:07.293490 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:07.293495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:07.293540 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:07.293993 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:07.294003 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.295227 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.295231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:07.296921 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:07.296935 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.298279 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.298286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:07.298457 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.298482 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:40:07.298606 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 08:40:07.298786 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":935,"thread_start_us":521,"threads_started":1}
I20260808 08:40:07.300491 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa4db332d046c48e1e2c0d6c75a6ad" candidate_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dae0209d830d437b83370f421d2bdc06" is_pre_election: true
I20260808 08:40:07.301247 21660 raft_consensus.cc:2454] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f566dbd8009f4ef3b765dfd6dcf83396 in term 0.
I20260808 08:40:07.302170 21373 leader_election.cc:302] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dae0209d830d437b83370f421d2bdc06, f566dbd8009f4ef3b765dfd6dcf83396; no voters:
I20260808 08:40:07.302763 21943 raft_consensus.cc:2781] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:07.302908 21943 raft_consensus.cc:482] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:07.302815 21847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa4db332d046c48e1e2c0d6c75a6ad" candidate_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850ef18ae14f45cdbc86485be6a9da0a" is_pre_election: true
I20260808 08:40:07.303061 21943 raft_consensus.cc:3037] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:07.303431 21847 raft_consensus.cc:2454] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f566dbd8009f4ef3b765dfd6dcf83396 in term 0.
I20260808 08:40:07.305640 21943 raft_consensus.cc:504] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:07.306389 21943 leader_election.cc:288] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [CANDIDATE]: Term 1 election: Requested vote from peers 850ef18ae14f45cdbc86485be6a9da0a (127.19.242.195:43607), dae0209d830d437b83370f421d2bdc06 (127.19.242.194:45783)
I20260808 08:40:07.307051 21847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa4db332d046c48e1e2c0d6c75a6ad" candidate_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "850ef18ae14f45cdbc86485be6a9da0a"
I20260808 08:40:07.307097 21660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53fa4db332d046c48e1e2c0d6c75a6ad" candidate_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dae0209d830d437b83370f421d2bdc06"
I20260808 08:40:07.307276 21847 raft_consensus.cc:3037] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:07.307374 21660 raft_consensus.cc:3037] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:07.309978 21847 raft_consensus.cc:2454] T 53fa4db332d046c48e1e2c0d6c75a6ad P 850ef18ae14f45cdbc86485be6a9da0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f566dbd8009f4ef3b765dfd6dcf83396 in term 1.
I20260808 08:40:07.310058 21660 raft_consensus.cc:2454] T 53fa4db332d046c48e1e2c0d6c75a6ad P dae0209d830d437b83370f421d2bdc06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f566dbd8009f4ef3b765dfd6dcf83396 in term 1.
I20260808 08:40:07.310504 21375 leader_election.cc:302] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 850ef18ae14f45cdbc86485be6a9da0a, f566dbd8009f4ef3b765dfd6dcf83396; no voters:
I20260808 08:40:07.310889 21943 raft_consensus.cc:2781] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:07.311447 21943 raft_consensus.cc:686] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [term 1 LEADER]: Becoming Leader. State: Replica: f566dbd8009f4ef3b765dfd6dcf83396, State: Running, Role: LEADER
I20260808 08:40:07.312048 21943 consensus_queue.cc:237] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } }
I20260808 08:40:07.317941 21271 catalog_manager.cc:5495] T 53fa4db332d046c48e1e2c0d6c75a6ad P f566dbd8009f4ef3b765dfd6dcf83396 reported cstate change: term changed from 0 to 1, leader changed from <none> to f566dbd8009f4ef3b765dfd6dcf83396 (127.19.242.193). New cstate: current_term: 1 leader_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "850ef18ae14f45cdbc86485be6a9da0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 43607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f566dbd8009f4ef3b765dfd6dcf83396" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dae0209d830d437b83370f421d2bdc06" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45783 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:40:07 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:07.383615 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.367427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49240 (local address 127.19.242.193:46087)
0808 08:40:07.367704 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.367711 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.367914 (+ 203us) server_negotiation.cc:407] Connection header received
0808 08:40:07.368071 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.368075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.368147 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.368276 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:07.369725 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.370482 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.371884 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.372320 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.372425 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.377170 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:07.377190 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:07.377209 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:07.377257 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:07.380566 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.381361 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.381370 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.381372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.381560 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.381953 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.381956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.381958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.382316 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:07.382558 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.382990 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.383256 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
Aug 08 08:40:07 dist-test-slave-39l8 krb5kdc[21196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178407, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:40:07 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178407, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:07.443361 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.427778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49248 (local address 127.19.242.193:46087)
0808 08:40:07.427998 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.428007 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.428417 (+ 410us) server_negotiation.cc:407] Connection header received
0808 08:40:07.428645 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.428649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.428721 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.428844 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:07.430339 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.431225 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.432543 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.432974 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.433125 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.437547 (+ 4422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:07.437553 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:07.437556 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:07.437602 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:07.440360 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.441169 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.441175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.441186 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.441342 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.441781 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.441791 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.441793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.442080 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:07.442399 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.442733 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.442994 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 08:40:07 dist-test-slave-39l8 krb5kdc[21196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:40:07 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:07.500809 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.485165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49262 (local address 127.19.242.193:46087)
0808 08:40:07.485471 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.485478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.485680 (+ 202us) server_negotiation.cc:407] Connection header received
0808 08:40:07.485904 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.485910 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.486058 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.486169 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:07.487708 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.488456 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.489859 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.490391 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.490516 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.495220 (+ 4704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:07.495226 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:07.495230 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:07.495311 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:07.498089 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.498922 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.498926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.498929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.499078 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.499472 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.499475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.499477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.499740 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:07.499945 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.500207 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.500435 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
W20260808 08:40:07.503564 21415 tablet_service.cc:2908] Rejecting scan request for tablet 53fa4db332d046c48e1e2c0d6c75a6ad: Uninitialized: clean time has not yet been initialized
I20260808 08:40:07.507607 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21354
I20260808 08:40:07.522785 21933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.508857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49278 (local address 127.19.242.193:46087)
0808 08:40:07.509047 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.509052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.509676 (+ 624us) server_negotiation.cc:407] Connection header received
0808 08:40:07.509906 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.509911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.509990 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.510103 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:07.511615 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.512370 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.513688 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.514132 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.514287 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.516927 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:07.516933 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:07.516936 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:07.516978 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:07.519845 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.520619 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.520625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.520629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.520784 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.521195 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.521201 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.521206 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.521502 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:07.521768 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.522125 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.522360 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:40:07.523566 21528 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:07.618508 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21354
I20260808 08:40:07.651405 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21541
Aug 08 08:40:07 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:07.668432 21934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.652290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.19.242.194:45783)
0808 08:40:07.652513 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.652521 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.652544 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:40:07.652804 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.652808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.652879 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.652996 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:07.654355 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.655188 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.656565 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.656999 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.657171 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.661770 (+ 4599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:07.661789 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:07.661806 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:07.661856 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:07.665065 (+ 3209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.665954 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.665964 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.665966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.666121 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.666575 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.666581 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.666592 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.667110 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:07.667462 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.667806 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.668050 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:40:07.669330 21721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:07.760596 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21541
I20260808 08:40:07.786512 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21733
Aug 08 08:40:07 dist-test-slave-39l8 krb5kdc[21196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:07.804749 21928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:07.787471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43526 (local address 127.19.242.195:43607)
0808 08:40:07.787665 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:07.787672 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:07.787868 (+ 196us) server_negotiation.cc:407] Connection header received
0808 08:40:07.788056 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:07.788062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:07.788141 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:07.788263 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:07.789554 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.790939 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.792515 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:07.793188 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:07.793334 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:07.798084 (+ 4750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:07.798100 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:07.798118 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:07.798164 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:07.801349 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.802293 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.802302 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.802304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.802451 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:07.803007 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:07.803011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:07.803014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:07.803437 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:07.803795 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:07.804085 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 08:40:07.804353 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:40:07.805493 21900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:07.899101 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21733
I20260808 08:40:07.926553 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21221
I20260808 08:40:07.927920 21309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:08.048161 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21221
2026-08-08T08:40:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (5107 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:08 dist-test-slave-39l8 krb5kdc[21971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:08 dist-test-slave-39l8 krb5kdc[21971](info): set up 2 sockets
Aug 08 08:40:08 dist-test-slave-39l8 krb5kdc[21971](info): commencing operation
krb5kdc: starting...
W20260808 08:40:09.351596 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:09 dist-test-slave-39l8 krb5kdc[21971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:09.592957 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44295
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:44295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:09.952505 21992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:09.952921 21992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:09.953100 21992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:09.960925 21992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:09.961122 21992 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:40:09.961208 21992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:09.961303 21992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:09.961401 21992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:09.961491 21992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:09.972396 21992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:44295
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:09.973899 21992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:09.975453 21992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:09.988797 22003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:09.988873 22001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:09.988809 22000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:09.990185 21992 server_base.cc:1034] running on GCE node
I20260808 08:40:09.991230 21992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:09.992924 21992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:09.994253 21992 hybrid_clock.cc:648] HybridClock initialized: now 1786178409994175 us; error 47 us; skew 500 ppm
I20260808 08:40:09.994697 21992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:09 dist-test-slave-39l8 krb5kdc[21971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178409, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:10.004186 21992 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:10.006325 21992 webserver.cc:460] Webserver started at http://127.19.242.254:43845/ using document root <none> and password file <none>
I20260808 08:40:10.007282 21992 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:10.007390 21992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:10.007758 21992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:10.011304 21992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "ddf760adaa7548f7ae6a8194a4048ddd"
format_stamp: "Formatted at 2026-08-08 08:40:10 on dist-test-slave-39l8"
server_key: "7fc02222d82b02f9f4f500b9afc18e07"
server_key_iv: "cd05db9084455b4107c41c679c0451eb"
server_key_version: "encryptionkey@0"
I20260808 08:40:10.012473 21992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "ddf760adaa7548f7ae6a8194a4048ddd"
format_stamp: "Formatted at 2026-08-08 08:40:10 on dist-test-slave-39l8"
server_key: "7fc02222d82b02f9f4f500b9afc18e07"
server_key_iv: "cd05db9084455b4107c41c679c0451eb"
server_key_version: "encryptionkey@0"
I20260808 08:40:10.020890 21992 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.008s
I20260808 08:40:10.025373 22014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:10.027436 21992 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:40:10.027706 21992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "ddf760adaa7548f7ae6a8194a4048ddd"
format_stamp: "Formatted at 2026-08-08 08:40:10 on dist-test-slave-39l8"
server_key: "7fc02222d82b02f9f4f500b9afc18e07"
server_key_iv: "cd05db9084455b4107c41c679c0451eb"
server_key_version: "encryptionkey@0"
I20260808 08:40:10.028021 21992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:10.057794 21992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:10.063354 21992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:10.063699 21992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:10.090574 21992 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:44295
I20260808 08:40:10.090590 22093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:44295 every 8 connection(s)
I20260808 08:40:10.092289 21992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:10.096949 22094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:10.098680 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21992
I20260808 08:40:10.098995 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:10.099833 20427 external_mini_cluster.cc:1428] Setting key 55ea0808f20128d3dedf2a9385eba42d
I20260808 08:40:10.113469 22094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd: Bootstrap starting.
Aug 08 08:40:10 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:10.117511 22094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:10.119118 22094 log.cc:824] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:10.123059 22094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd: No bootstrap required, opened a new log
I20260808 08:40:10.127456 22097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:10.102886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33466 (local address 127.19.242.254:44295)
0808 08:40:10.103848 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:10.103862 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:10.103909 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:40:10.105815 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:10.105849 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:10.106399 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:10.106910 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:10.108612 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.110023 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.111535 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.112346 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.112579 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:10.117578 (+ 4999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:10.117587 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:10.117605 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:10.117681 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:10.121702 (+ 4021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:10.122568 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:10.122576 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:10.122584 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:10.122855 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:10.123367 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:10.123373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:10.123376 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:10.124276 (+ 900us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:10.124635 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:10.125116 (+ 481us) server_negotiation.cc:299] Negotiation successful
0808 08:40:10.125716 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":423,"threads_started":1}
I20260808 08:40:10.134646 22094 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44295 } }
I20260808 08:40:10.135170 22094 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:10.135263 22094 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf760adaa7548f7ae6a8194a4048ddd, State: Initialized, Role: FOLLOWER
I20260808 08:40:10.135852 22094 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44295 } }
I20260808 08:40:10.136092 22094 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:10.136219 22094 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:10.136363 22094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:10.138932 22094 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44295 } }
I20260808 08:40:10.139613 22094 leader_election.cc:302] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddf760adaa7548f7ae6a8194a4048ddd; no voters:
I20260808 08:40:10.140414 22094 leader_election.cc:288] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:10.140568 22099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:10.141381 22099 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [term 1 LEADER]: Becoming Leader. State: Replica: ddf760adaa7548f7ae6a8194a4048ddd, State: Running, Role: LEADER
I20260808 08:40:10.142036 22099 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44295 } }
I20260808 08:40:10.143020 22094 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:10.145015 22100 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44295 } } }
I20260808 08:40:10.145485 22100 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:10.151304 22109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:10.151003 22101 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddf760adaa7548f7ae6a8194a4048ddd. Latest consensus state: current_term: 1 leader_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf760adaa7548f7ae6a8194a4048ddd" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44295 } } }
I20260808 08:40:10.151672 22101 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:10.157114 22109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:10.167913 22109 catalog_manager.cc:1347] Generated new cluster ID: d0af1f3259ff419b9f5480522b360d21
I20260808 08:40:10.168123 22109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:10.184906 22109 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:10.187330 22109 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:10.199391 22109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd: Generated new TSK 0
I20260808 08:40:10.200429 22109 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:10.263279 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44295
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:10.693415 22129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:10.693766 22129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:10.693872 22129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:10.702075 22129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:10.702256 22129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:10.702358 22129 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:40:10.702445 22129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:10.713244 22129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:44295
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:10.714761 22129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:10.716248 22129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:10.731309 22136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:10.731384 22138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:10.731410 22140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:10.732601 22129 server_base.cc:1034] running on GCE node
I20260808 08:40:10.733385 22129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:10.734620 22129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:10.735944 22129 hybrid_clock.cc:648] HybridClock initialized: now 1786178410735867 us; error 49 us; skew 500 ppm
I20260808 08:40:10.736312 22129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:10 dist-test-slave-39l8 krb5kdc[21971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178410, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:10.740325 22129 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:10.742235 22129 webserver.cc:460] Webserver started at http://127.19.242.193:33223/ using document root <none> and password file <none>
I20260808 08:40:10.743345 22129 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:10.743515 22129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:10.743924 22129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:10.747699 22129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "d9075009b6814123b01eb89440ef0b76"
format_stamp: "Formatted at 2026-08-08 08:40:10 on dist-test-slave-39l8"
server_key: "b029ec8b668df31671708bd3e8fa4109"
server_key_iv: "daab34600743a3fed5ffa2076bb00db7"
server_key_version: "encryptionkey@0"
I20260808 08:40:10.748756 22129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "d9075009b6814123b01eb89440ef0b76"
format_stamp: "Formatted at 2026-08-08 08:40:10 on dist-test-slave-39l8"
server_key: "b029ec8b668df31671708bd3e8fa4109"
server_key_iv: "daab34600743a3fed5ffa2076bb00db7"
server_key_version: "encryptionkey@0"
I20260808 08:40:10.755927 22129 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260808 08:40:10.760275 22148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:10.761960 22129 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:40:10.762205 22129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "d9075009b6814123b01eb89440ef0b76"
format_stamp: "Formatted at 2026-08-08 08:40:10 on dist-test-slave-39l8"
server_key: "b029ec8b668df31671708bd3e8fa4109"
server_key_iv: "daab34600743a3fed5ffa2076bb00db7"
server_key_version: "encryptionkey@0"
I20260808 08:40:10.762490 22129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:10.784860 22129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:10.790129 22129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:10.790516 22129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:10.793895 22129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:10.794037 22129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:10.794237 22129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:10.794314 22129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:40:10 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178410, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:10.826419 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:10.795071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:48757 (local address 127.19.242.254:44295)
0808 08:40:10.795679 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:10.795683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:10.797071 (+ 1388us) server_negotiation.cc:407] Connection header received
0808 08:40:10.799748 (+ 2677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:10.799758 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:10.799859 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:10.800007 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:10.803426 (+ 3419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.804826 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.808343 (+ 3517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.809154 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.809356 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:10.816525 (+ 7169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:10.816536 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:10.816541 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:10.816601 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:10.820811 (+ 4210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:10.822426 (+ 1615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:10.822432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:10.822436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:10.822636 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:10.823506 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:10.823511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:10.823514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:10.823994 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:10.824220 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:10.825576 (+ 1356us) server_negotiation.cc:299] Negotiation successful
0808 08:40:10.825928 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":286,"threads_started":1}
I20260808 08:40:10.828554 22161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:10.795921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44295 (local address 127.19.242.193:48757)
0808 08:40:10.796870 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:10.796914 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:10.799155 (+ 2241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:10.800613 (+ 1458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:10.800628 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:10.801668 (+ 1040us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:10.803060 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:10.803100 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.805083 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.805092 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:10.808020 (+ 2928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:10.808053 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.809521 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.809532 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:10.809990 (+ 458us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:10.811307 (+ 1317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:10.811367 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:10.816072 (+ 4705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:10.821080 (+ 5008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:10.821092 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:10.821115 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:10.822183 (+ 1068us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:10.822844 (+ 661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:10.822854 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:10.822861 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:10.823312 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:10.824192 (+ 880us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:10.824205 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:10.824960 (+ 755us) client_negotiation.cc:769] Sending connection context
0808 08:40:10.825417 (+ 457us) client_negotiation.cc:240] Negotiation successful
0808 08:40:10.826250 (+ 833us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":419,"threads_started":1}
I20260808 08:40:10.840932 22129 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:33261
I20260808 08:40:10.840977 22314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:33261 every 8 connection(s)
I20260808 08:40:10.842466 22129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:10.843271 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 22129
I20260808 08:40:10.843569 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:10.844609 20427 external_mini_cluster.cc:1428] Setting key 9a03c6a14ca7d93c5b5aa1f9c2d06b23
I20260808 08:40:10.845243 22318 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44295
I20260808 08:40:10.845518 22318 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:10.847564 22318 heartbeater.cc:511] Master 127.19.242.254:44295 requested a full tablet report, sending...
I20260808 08:40:10.850293 22034 ts_manager.cc:194] Registered new tserver with Master: d9075009b6814123b01eb89440ef0b76 (127.19.242.193:33261)
I20260808 08:40:10.852784 22034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:48757
I20260808 08:40:10.856037 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:10.839621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:46505 (local address 127.19.242.254:44295)
0808 08:40:10.839895 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:10.839904 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:10.841064 (+ 1160us) server_negotiation.cc:407] Connection header received
0808 08:40:10.841322 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:10.841328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:10.841412 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:10.841533 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:10.842587 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.843688 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.845852 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.846632 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.846872 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:10.849241 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:10.849248 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:10.849252 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:10.849296 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:10.852650 (+ 3354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:10.853676 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:10.853683 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:10.853692 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:10.853886 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:10.854284 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:10.854290 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:10.854293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:10.854673 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:10.854866 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:10.855454 (+ 588us) server_negotiation.cc:299] Negotiation successful
0808 08:40:10.855706 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 08:40:10.856274 22313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:10.839656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44295 (local address 127.19.242.193:46505)
0808 08:40:10.840889 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:10.840918 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:10.841142 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:10.841563 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:10.841567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:10.842092 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:10.842406 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:10.842417 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.843930 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.843936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:10.845651 (+ 1715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:10.845668 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:10.847193 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:10.847205 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:10.847409 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:10.848213 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:10.848241 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:10.849030 (+ 789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:10.852842 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:10.852848 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:10.852852 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:10.853526 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:10.854001 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:10.854006 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:10.854009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:10.854161 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:10.854861 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:10.854870 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:10.855144 (+ 274us) client_negotiation.cc:769] Sending connection context
0808 08:40:10.855325 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 08:40:10.855769 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1054,"mutex_wait_us":4,"thread_start_us":877,"threads_started":1}
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:10.902261 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44295
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:11.285912 22324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:11.286331 22324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:11.286532 22324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:11.294258 22324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:11.294469 22324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:11.294639 22324 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:40:11.294818 22324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:11.305469 22324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:44295
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:11.306993 22324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:11.308512 22324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:11.323380 22336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:11.323546 22333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:11.323730 22332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:11.325194 22324 server_base.cc:1034] running on GCE node
I20260808 08:40:11.326073 22324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:11.327373 22324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:11.328660 22324 hybrid_clock.cc:648] HybridClock initialized: now 1786178411328587 us; error 46 us; skew 500 ppm
I20260808 08:40:11.329018 22324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:11 dist-test-slave-39l8 krb5kdc[21971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:11.333066 22324 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:11.335043 22324 webserver.cc:460] Webserver started at http://127.19.242.194:46151/ using document root <none> and password file <none>
I20260808 08:40:11.335884 22324 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:11.336042 22324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:11.336436 22324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:11.340118 22324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "a0d089d20be747f195d083b3541eedc0"
format_stamp: "Formatted at 2026-08-08 08:40:11 on dist-test-slave-39l8"
server_key: "3e08c4f5212708b61f1a80fc33609988"
server_key_iv: "5cc96f0142fc06367388bf51fdad29c0"
server_key_version: "encryptionkey@0"
I20260808 08:40:11.341094 22324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "a0d089d20be747f195d083b3541eedc0"
format_stamp: "Formatted at 2026-08-08 08:40:11 on dist-test-slave-39l8"
server_key: "3e08c4f5212708b61f1a80fc33609988"
server_key_iv: "5cc96f0142fc06367388bf51fdad29c0"
server_key_version: "encryptionkey@0"
I20260808 08:40:11.347756 22324 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 08:40:11.352411 22346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:11.354313 22324 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260808 08:40:11.354574 22324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "a0d089d20be747f195d083b3541eedc0"
format_stamp: "Formatted at 2026-08-08 08:40:11 on dist-test-slave-39l8"
server_key: "3e08c4f5212708b61f1a80fc33609988"
server_key_iv: "5cc96f0142fc06367388bf51fdad29c0"
server_key_version: "encryptionkey@0"
I20260808 08:40:11.354955 22324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:11.389181 22324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:11.394459 22324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:11.394841 22324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:11.397990 22324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:11.398132 22324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:11.398314 22324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:11.398424 22324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:40:11 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:11.428821 22356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:11.399262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:54809 (local address 127.19.242.254:44295)
0808 08:40:11.400077 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:11.400084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:11.401444 (+ 1360us) server_negotiation.cc:407] Connection header received
0808 08:40:11.405078 (+ 3634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:11.405086 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:11.405188 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:11.405358 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:11.407344 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.408731 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.412636 (+ 3905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.413334 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.413511 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:11.419694 (+ 6183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:11.419700 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:11.419704 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:11.419746 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:11.423614 (+ 3868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:11.424993 (+ 1379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:11.425004 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:11.425007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:11.425228 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:11.426056 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:11.426064 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:11.426067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:11.426380 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:11.426609 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:11.427785 (+ 1176us) server_negotiation.cc:299] Negotiation successful
0808 08:40:11.428171 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":436,"threads_started":1}
I20260808 08:40:11.429806 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:11.400048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44295 (local address 127.19.242.194:54809)
0808 08:40:11.401193 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:11.401266 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:11.404443 (+ 3177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:11.405659 (+ 1216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:11.405668 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:11.406284 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:11.407062 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:11.407092 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.409029 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.409035 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:11.412355 (+ 3320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:11.412382 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.413701 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.413714 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:11.414164 (+ 450us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:11.415348 (+ 1184us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:11.415379 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:11.419340 (+ 3961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:11.423914 (+ 4574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:11.423932 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:11.423962 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:11.424794 (+ 832us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:11.425407 (+ 613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:11.425419 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:11.425426 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:11.425866 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:11.426764 (+ 898us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:11.426779 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:11.427244 (+ 465us) client_negotiation.cc:769] Sending connection context
0808 08:40:11.427507 (+ 263us) client_negotiation.cc:240] Negotiation successful
0808 08:40:11.427984 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":769,"thread_start_us":505,"threads_started":1}
I20260808 08:40:11.458273 22356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:11.438010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:50003 (local address 127.19.242.254:44295)
0808 08:40:11.438286 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:11.438296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:11.438774 (+ 478us) server_negotiation.cc:407] Connection header received
0808 08:40:11.439096 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:11.439101 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:11.439198 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:11.439347 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:11.441769 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.443262 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.446006 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.446509 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.446774 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:11.449453 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:11.449465 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:11.449473 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:11.449535 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:11.454374 (+ 4839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:11.455680 (+ 1306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:11.455689 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:11.455694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:11.455900 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:11.456528 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:11.456532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:11.456534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:11.456919 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:11.457056 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:11.457788 (+ 732us) server_negotiation.cc:299] Negotiation successful
0808 08:40:11.458012 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:40:11.459142 22446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:11.437806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44295 (local address 127.19.242.194:50003)
0808 08:40:11.438607 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:11.438634 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:11.438905 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:11.439455 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:11.439462 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:11.440436 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:11.441345 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:11.441380 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.443580 (+ 2200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.443588 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:11.445746 (+ 2158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:11.445779 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:11.446825 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:11.446834 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:11.447078 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:11.448064 (+ 986us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:11.448088 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:11.449105 (+ 1017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:11.454598 (+ 5493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:11.454603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:11.454607 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:11.455399 (+ 792us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:11.456047 (+ 648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:11.456053 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:11.456056 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:11.456321 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:11.457075 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:11.457084 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:11.457385 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 08:40:11.457601 (+ 216us) client_negotiation.cc:240] Negotiation successful
0808 08:40:11.458131 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":418,"threads_started":1}
I20260808 08:40:11.465013 22324 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:36813
I20260808 08:40:11.465034 22506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:36813 every 8 connection(s)
I20260808 08:40:11.466441 22324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:11.469034 22507 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44295
I20260808 08:40:11.469393 22507 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:11.470173 22507 heartbeater.cc:511] Master 127.19.242.254:44295 requested a full tablet report, sending...
I20260808 08:40:11.470675 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 22324
I20260808 08:40:11.470961 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:11.471531 20427 external_mini_cluster.cc:1428] Setting key 1422eedf0b0d229c3530aad6194ab3a2
I20260808 08:40:11.472064 22034 ts_manager.cc:194] Registered new tserver with Master: a0d089d20be747f195d083b3541eedc0 (127.19.242.194:36813)
I20260808 08:40:11.472988 22034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:54809
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:11.527406 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44295
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:40:11.857134 22318 heartbeater.cc:503] Master 127.19.242.254:44295 was elected leader, sending a full tablet report...
W20260808 08:40:11.900928 22512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:11.901358 22512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:11.901558 22512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:11.909384 22512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:11.909535 22512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:11.909680 22512 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:40:11.909792 22512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:11.920594 22512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:44295
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:11.922183 22512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:11.923700 22512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:11.938534 22518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:11.938869 22520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:11.938967 22517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:11.939838 22512 server_base.cc:1034] running on GCE node
I20260808 08:40:11.940642 22512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:11.941718 22512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:11.942986 22512 hybrid_clock.cc:648] HybridClock initialized: now 1786178411942904 us; error 59 us; skew 500 ppm
I20260808 08:40:11.943429 22512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:11 dist-test-slave-39l8 krb5kdc[21971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:11.947096 22512 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:11.948777 22512 webserver.cc:460] Webserver started at http://127.19.242.195:43489/ using document root <none> and password file <none>
I20260808 08:40:11.949548 22512 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:11.949646 22512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:11.949939 22512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:11.953428 22512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "58103f5fdf1c45429f8e1face7801e92"
format_stamp: "Formatted at 2026-08-08 08:40:11 on dist-test-slave-39l8"
server_key: "9943e113995a22ffbebe36efe3559c78"
server_key_iv: "9079b0e2143460f50093007686656e35"
server_key_version: "encryptionkey@0"
I20260808 08:40:11.954353 22512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "58103f5fdf1c45429f8e1face7801e92"
format_stamp: "Formatted at 2026-08-08 08:40:11 on dist-test-slave-39l8"
server_key: "9943e113995a22ffbebe36efe3559c78"
server_key_iv: "9079b0e2143460f50093007686656e35"
server_key_version: "encryptionkey@0"
I20260808 08:40:11.960776 22512 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 08:40:11.965246 22528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:11.967176 22512 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:40:11.967355 22512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "58103f5fdf1c45429f8e1face7801e92"
format_stamp: "Formatted at 2026-08-08 08:40:11 on dist-test-slave-39l8"
server_key: "9943e113995a22ffbebe36efe3559c78"
server_key_iv: "9079b0e2143460f50093007686656e35"
server_key_version: "encryptionkey@0"
I20260808 08:40:11.967629 22512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:12.002599 22512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:12.008164 22512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:12.008500 22512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:12.011986 22512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:12.012156 22512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:12.012354 22512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:12.012485 22512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:40:12 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:12.048467 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.015697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:45973 (local address 127.19.242.254:44295)
0808 08:40:12.020881 (+ 5184us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.020891 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.020922 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:40:12.021009 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.021016 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.021119 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.021290 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:12.025701 (+ 4411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.026617 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.030673 (+ 4056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.031334 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.031539 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.038453 (+ 6914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:12.038463 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:12.038468 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:12.038528 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:12.043258 (+ 4730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.044846 (+ 1588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.044855 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.044860 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.045080 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.045787 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.045792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.045795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.046266 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:12.046461 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.047757 (+ 1296us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.048032 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5005,"thread_start_us":4890,"threads_started":1}
I20260808 08:40:12.049671 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.013423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44295 (local address 127.19.242.195:45973)
0808 08:40:12.014655 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.014751 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.017683 (+ 2932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.022000 (+ 4317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.022024 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.023515 (+ 1491us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:12.025051 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.025108 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.026922 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.026933 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.030267 (+ 3334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.030300 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.031724 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.031736 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.032184 (+ 448us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.033395 (+ 1211us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:12.033433 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:12.037772 (+ 4339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:12.043548 (+ 5776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:12.043562 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:12.043592 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:12.044567 (+ 975us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:12.045284 (+ 717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:12.045291 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:12.045295 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:12.045552 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:12.046476 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:12.046492 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:12.047206 (+ 714us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.047632 (+ 426us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.048292 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":543,"threads_started":1}
I20260808 08:40:12.068885 22512 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:33843
I20260808 08:40:12.068903 22680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:33843 every 8 connection(s)
I20260808 08:40:12.070667 22512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:12.073926 22681 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44295
I20260808 08:40:12.074450 22681 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:12.075560 22681 heartbeater.cc:511] Master 127.19.242.254:44295 requested a full tablet report, sending...
I20260808 08:40:12.076992 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 22512
I20260808 08:40:12.077229 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:12.077533 22653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.057367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44295 (local address 127.19.242.195:54177)
0808 08:40:12.058344 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.058367 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.058573 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.059044 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.059054 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.059933 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:12.060538 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.060558 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.062506 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.062511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.065128 (+ 2617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.065161 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.066810 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.066820 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.067018 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.067914 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:12.067937 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:12.069532 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:12.074213 (+ 4681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:12.074226 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:12.074229 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:12.075091 (+ 862us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:12.075595 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:12.075602 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:12.075605 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:12.075812 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:12.076436 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:12.076443 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:12.076658 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.076815 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.077197 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"thread_start_us":593,"threads_started":1}
I20260808 08:40:12.077638 22032 ts_manager.cc:194] Registered new tserver with Master: 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843)
I20260808 08:40:12.077826 20427 external_mini_cluster.cc:1428] Setting key b369cb39b37008d594941cc5c97fb652
I20260808 08:40:12.078399 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.057219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:54177 (local address 127.19.242.254:44295)
0808 08:40:12.057437 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.057446 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.058493 (+ 1047us) server_negotiation.cc:407] Connection header received
0808 08:40:12.058789 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.058794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.058871 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.058968 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:12.060816 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.062190 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.065461 (+ 3271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.066302 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.066415 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.069806 (+ 3391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:12.069815 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:12.069820 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:12.069868 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:12.073989 (+ 4121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.075265 (+ 1276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.075272 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.075276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.075454 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.075955 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.075961 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.075964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.076282 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:12.076516 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.077890 (+ 1374us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.078101 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:40:12.079043 22032 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:45973
I20260808 08:40:12.081624 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:40:12 dist-test-slave-39l8 krb5kdc[21971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:40:12 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:12.146320 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.128003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33070 (local address 127.19.242.254:44295)
0808 08:40:12.128197 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.128202 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.128782 (+ 580us) server_negotiation.cc:407] Connection header received
0808 08:40:12.129010 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.129015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.129089 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.129213 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:12.130996 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.132140 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.134010 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.134480 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.134659 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.139548 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:12.139555 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:12.139559 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:12.139610 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:12.142995 (+ 3385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.143917 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.143923 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.143925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.144135 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.144654 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.144657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.144660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.144983 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:12.145255 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.145656 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.145854 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:40:12.151989 22034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:12.160465 22034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:12.188318 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.175580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:36813 (local address 127.0.0.1:54556)
0808 08:40:12.178885 (+ 3305us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.178925 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.179160 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.180195 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.180203 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.180239 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:12.180718 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.180733 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.182691 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.182696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.184928 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.184942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.186961 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.186969 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.187291 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.187369 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.187551 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.187803 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2995,"mutex_wait_us":57,"thread_start_us":2785,"threads_started":1}
I20260808 08:40:12.188336 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.176368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44352 (local address 127.19.242.193:33261)
0808 08:40:12.177759 (+ 1391us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.177774 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.180054 (+ 2280us) server_negotiation.cc:407] Connection header received
0808 08:40:12.180170 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.180180 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.180413 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.180630 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:12.181588 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.182959 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.185767 (+ 2808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.186836 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.187020 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.187216 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.187763 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.187991 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1198,"thread_start_us":1056,"threads_started":1}
I20260808 08:40:12.189189 22700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.175654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:33261 (local address 127.0.0.1:44352)
0808 08:40:12.179733 (+ 4079us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.179756 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.179916 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.180872 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.180876 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.180901 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:12.181366 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.181383 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.183192 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.183200 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.185582 (+ 2382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.185596 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.187282 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.187289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.187484 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.187518 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.187615 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.188784 (+ 1169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3909,"mutex_wait_us":993,"thread_start_us":3748,"threads_started":1}
I20260808 08:40:12.189690 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.175773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54556 (local address 127.19.242.194:36813)
0808 08:40:12.178334 (+ 2561us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.178347 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.179265 (+ 918us) server_negotiation.cc:407] Connection header received
0808 08:40:12.179390 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.179401 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.179699 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.179916 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:12.180938 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.182525 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.185126 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.186628 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.186879 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.187080 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.189190 (+ 2110us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.189442 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2345,"thread_start_us":2148,"threads_started":1}
I20260808 08:40:12.192291 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.180702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33843 (local address 127.0.0.1:43348)
0808 08:40:12.181543 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.181562 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.181700 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.182304 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.182308 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.182333 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:12.183085 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.183108 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.185537 (+ 2429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.185543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.187803 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.187818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.191144 (+ 3326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.191152 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.191340 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.191375 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.191517 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.191811 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":29,"thread_start_us":515,"threads_started":1}
I20260808 08:40:12.192279 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.180235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43348 (local address 127.19.242.195:33843)
0808 08:40:12.181003 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.181011 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.181690 (+ 679us) server_negotiation.cc:407] Connection header received
0808 08:40:12.181862 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.181869 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.182094 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.182282 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:12.183378 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.185363 (+ 1985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.188464 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.190897 (+ 2433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.191162 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.191364 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.191569 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.191893 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":627,"threads_started":1}
I20260808 08:40:12.194135 22216 tablet_service.cc:1467] Processing CreateTablet for tablet 4b066dae529a4e9eb0e643952a51900e (DEFAULT_TABLE table=test-table [id=1014841e51204626875b95d5ff4a8ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:12.194161 22411 tablet_service.cc:1467] Processing CreateTablet for tablet 4b066dae529a4e9eb0e643952a51900e (DEFAULT_TABLE table=test-table [id=1014841e51204626875b95d5ff4a8ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:12.195953 22411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b066dae529a4e9eb0e643952a51900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.195952 22216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b066dae529a4e9eb0e643952a51900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.196756 22594 tablet_service.cc:1467] Processing CreateTablet for tablet 4b066dae529a4e9eb0e643952a51900e (DEFAULT_TABLE table=test-table [id=1014841e51204626875b95d5ff4a8ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:12.198143 22594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b066dae529a4e9eb0e643952a51900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.211499 22709 tablet_bootstrap.cc:492] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Bootstrap starting.
I20260808 08:40:12.215251 22709 tablet_bootstrap.cc:654] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.216528 22709 log.cc:824] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:12.219522 22710 tablet_bootstrap.cc:492] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Bootstrap starting.
I20260808 08:40:12.220963 22711 tablet_bootstrap.cc:492] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Bootstrap starting.
I20260808 08:40:12.221962 22709 tablet_bootstrap.cc:492] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: No bootstrap required, opened a new log
I20260808 08:40:12.222322 22709 ts_tablet_manager.cc:1397] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260808 08:40:12.223951 22710 tablet_bootstrap.cc:654] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.225003 22711 tablet_bootstrap.cc:654] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.225421 22710 log.cc:824] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:12.226409 22711 log.cc:824] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:12.229182 22710 tablet_bootstrap.cc:492] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: No bootstrap required, opened a new log
I20260808 08:40:12.229640 22710 ts_tablet_manager.cc:1397] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260808 08:40:12.237498 22709 raft_consensus.cc:348] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.238245 22709 raft_consensus.cc:374] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.238487 22709 raft_consensus.cc:729] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58103f5fdf1c45429f8e1face7801e92, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.239349 22709 consensus_queue.cc:260] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.239387 22710 raft_consensus.cc:348] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.240083 22710 raft_consensus.cc:374] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.240280 22710 raft_consensus.cc:729] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d089d20be747f195d083b3541eedc0, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.240721 22681 heartbeater.cc:503] Master 127.19.242.254:44295 was elected leader, sending a full tablet report...
I20260808 08:40:12.241457 22709 ts_tablet_manager.cc:1428] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Time spent starting tablet: real 0.019s user 0.011s sys 0.007s
I20260808 08:40:12.241272 22710 consensus_queue.cc:260] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.242139 22711 tablet_bootstrap.cc:492] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: No bootstrap required, opened a new log
I20260808 08:40:12.242516 22711 ts_tablet_manager.cc:1397] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Time spent bootstrapping tablet: real 0.023s user 0.020s sys 0.000s
I20260808 08:40:12.243477 22507 heartbeater.cc:503] Master 127.19.242.254:44295 was elected leader, sending a full tablet report...
I20260808 08:40:12.244578 22710 ts_tablet_manager.cc:1428] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Time spent starting tablet: real 0.015s user 0.008s sys 0.007s
I20260808 08:40:12.254423 22711 raft_consensus.cc:348] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.255030 22711 raft_consensus.cc:374] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.255182 22711 raft_consensus.cc:729] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9075009b6814123b01eb89440ef0b76, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.255854 22711 consensus_queue.cc:260] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.257582 22711 ts_tablet_manager.cc:1428] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
W20260808 08:40:12.323364 22682 tablet.cc:2369] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:40:12.349045 22319 tablet.cc:2369] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:40:12.349098 22717 raft_consensus.cc:482] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:12.349473 22717 raft_consensus.cc:504] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.351516 22717 leader_election.cc:288] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9075009b6814123b01eb89440ef0b76 (127.19.242.193:33261), 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843)
I20260808 08:40:12.361158 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.352076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:38237 (local address 127.19.242.193:33261)
0808 08:40:12.352322 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.352328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.353057 (+ 729us) server_negotiation.cc:407] Connection header received
0808 08:40:12.353458 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.353464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.353566 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.353641 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:12.354389 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.355604 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.358393 (+ 2789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.359879 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.360081 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.360169 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.360816 (+ 647us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.360944 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:40:12.361534 22719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.351913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:33261 (local address 127.19.242.194:38237)
0808 08:40:12.352918 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.352941 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.353178 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.353863 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.353867 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.353891 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:12.354218 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.354228 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.355752 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.355756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.358131 (+ 2375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.358151 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.360315 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.360324 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.360540 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.360623 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.360745 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.361003 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":63,"thread_start_us":452,"threads_started":1}
I20260808 08:40:12.361562 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.352978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33843 (local address 127.19.242.194:53407)
0808 08:40:12.353662 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.353678 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.353850 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.354248 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.354252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.354277 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:12.354646 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.354656 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.356105 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.356117 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.358233 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.358248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.360334 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.360341 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.360556 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.360625 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.360744 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.361003 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"mutex_wait_us":117,"thread_start_us":327,"threads_started":1}
I20260808 08:40:12.361982 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.353302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:53407 (local address 127.19.242.195:33843)
0808 08:40:12.353547 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.353554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.353779 (+ 225us) server_negotiation.cc:407] Connection header received
0808 08:40:12.354001 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.354007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.354081 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.354240 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:12.354883 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.355962 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.358411 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.359873 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.360081 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.360168 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.361473 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.361643 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 08:40:12.363075 22245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b066dae529a4e9eb0e643952a51900e" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9075009b6814123b01eb89440ef0b76" is_pre_election: true
I20260808 08:40:12.363071 22624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b066dae529a4e9eb0e643952a51900e" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58103f5fdf1c45429f8e1face7801e92" is_pre_election: true
I20260808 08:40:12.363621 22245 raft_consensus.cc:2454] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 0.
I20260808 08:40:12.363615 22624 raft_consensus.cc:2454] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 0.
I20260808 08:40:12.364377 22351 leader_election.cc:302] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58103f5fdf1c45429f8e1face7801e92, a0d089d20be747f195d083b3541eedc0; no voters:
I20260808 08:40:12.364838 22717 raft_consensus.cc:2781] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:12.365029 22717 raft_consensus.cc:482] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:12.365159 22717 raft_consensus.cc:3037] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.367949 22717 raft_consensus.cc:504] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.368639 22717 leader_election.cc:288] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 election: Requested vote from peers d9075009b6814123b01eb89440ef0b76 (127.19.242.193:33261), 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843)
I20260808 08:40:12.369333 22245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b066dae529a4e9eb0e643952a51900e" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9075009b6814123b01eb89440ef0b76"
I20260808 08:40:12.369467 22624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b066dae529a4e9eb0e643952a51900e" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58103f5fdf1c45429f8e1face7801e92"
I20260808 08:40:12.369577 22245 raft_consensus.cc:3037] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.369760 22624 raft_consensus.cc:3037] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.372495 22245 raft_consensus.cc:2454] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 1.
I20260808 08:40:12.372952 22624 raft_consensus.cc:2454] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 1.
I20260808 08:40:12.373162 22351 leader_election.cc:302] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0d089d20be747f195d083b3541eedc0, d9075009b6814123b01eb89440ef0b76; no voters:
I20260808 08:40:12.373615 22717 raft_consensus.cc:2781] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:12.374245 22717 raft_consensus.cc:686] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 1 LEADER]: Becoming Leader. State: Replica: a0d089d20be747f195d083b3541eedc0, State: Running, Role: LEADER
I20260808 08:40:12.374925 22717 consensus_queue.cc:237] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.379930 22034 catalog_manager.cc:5495] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0d089d20be747f195d083b3541eedc0 (127.19.242.194). New cstate: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } health_report { overall_health: UNKNOWN } } }
I20260808 08:40:12.448177 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.441363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54566 (local address 127.19.242.194:36813)
0808 08:40:12.441588 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.441593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.441788 (+ 195us) server_negotiation.cc:407] Connection header received
0808 08:40:12.442193 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.442198 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.442295 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.442446 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:12.442889 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.443774 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.445338 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.445818 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.445940 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.446594 (+ 654us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:12.447442 (+ 848us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:12.447574 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.447784 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.447873 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:40:12.465135 22624 raft_consensus.cc:1261] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Refusing update from remote peer a0d089d20be747f195d083b3541eedc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:12.466208 22245 raft_consensus.cc:1261] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Refusing update from remote peer a0d089d20be747f195d083b3541eedc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:12.466889 22722 consensus_queue.cc:1035] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:12.467540 22717 consensus_queue.cc:1035] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:40:12.468863 22508 tablet.cc:2369] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:40:12.483855 22730 mvcc.cc:205] Tried to move back new op lower bound from 7316186777419497472 to 7316186777092472832. Current Snapshot: MvccSnapshot[applied={T|T < 7316186777419497472}]
I20260808 08:40:12.492415 22732 mvcc.cc:205] Tried to move back new op lower bound from 7316186777419497472 to 7316186777092472832. Current Snapshot: MvccSnapshot[applied={T|T < 7316186777419497472}]
I20260808 08:40:12.509328 22034 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:12.509685 22034 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:12.514928 22034 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd: Sending DeleteTablet for 3 replicas of tablet 4b066dae529a4e9eb0e643952a51900e
I20260808 08:40:12.516942 22411 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b066dae529a4e9eb0e643952a51900e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:12 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:54556
I20260808 08:40:12.516827 22216 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b066dae529a4e9eb0e643952a51900e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:12 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:44352
I20260808 08:40:12.517915 22594 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b066dae529a4e9eb0e643952a51900e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:12 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:43348
I20260808 08:40:12.518644 22034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:12.519663 22034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:12.522003 22745 tablet_replica.cc:330] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: stopping tablet replica
I20260808 08:40:12.523437 22744 tablet_replica.cc:330] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: stopping tablet replica
I20260808 08:40:12.523799 22745 raft_consensus.cc:2229] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:12.525174 22745 raft_consensus.cc:2258] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:12.525936 22744 raft_consensus.cc:2229] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:12.527087 22744 raft_consensus.cc:2258] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:12.528455 22743 tablet_replica.cc:330] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: stopping tablet replica
I20260808 08:40:12.529347 22743 raft_consensus.cc:2229] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:12.529906 22743 raft_consensus.cc:2258] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:12.530108 22745 ts_tablet_manager.cc:1905] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:12.530110 22744 ts_tablet_manager.cc:1905] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:12.532276 22410 tablet_service.cc:1467] Processing CreateTablet for tablet 4df7305890cf45e09b97668447a2218c (DEFAULT_TABLE table=test-table [id=9b50d1d2e9f644979091e891de136638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:12.533036 22410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df7305890cf45e09b97668447a2218c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.536427 22594 tablet_service.cc:1467] Processing CreateTablet for tablet 4df7305890cf45e09b97668447a2218c (DEFAULT_TABLE table=test-table [id=9b50d1d2e9f644979091e891de136638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:12.537061 22594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df7305890cf45e09b97668447a2218c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.538367 22745 ts_tablet_manager.cc:1918] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:12.538668 22745 log.cc:1196] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/4b066dae529a4e9eb0e643952a51900e
I20260808 08:40:12.539515 22745 ts_tablet_manager.cc:1939] T 4b066dae529a4e9eb0e643952a51900e P 58103f5fdf1c45429f8e1face7801e92: Deleting consensus metadata
I20260808 08:40:12.539937 22744 ts_tablet_manager.cc:1918] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:12.540185 22744 log.cc:1196] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/4b066dae529a4e9eb0e643952a51900e
I20260808 08:40:12.540848 22744 ts_tablet_manager.cc:1939] T 4b066dae529a4e9eb0e643952a51900e P a0d089d20be747f195d083b3541eedc0: Deleting consensus metadata
I20260808 08:40:12.541896 22018 catalog_manager.cc:4841] TS 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843): tablet 4b066dae529a4e9eb0e643952a51900e (table test-table [id=1014841e51204626875b95d5ff4a8ac7]) successfully deleted
I20260808 08:40:12.542917 22016 catalog_manager.cc:4841] TS a0d089d20be747f195d083b3541eedc0 (127.19.242.194:36813): tablet 4b066dae529a4e9eb0e643952a51900e (table test-table [id=1014841e51204626875b95d5ff4a8ac7]) successfully deleted
I20260808 08:40:12.544385 22743 ts_tablet_manager.cc:1905] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:12.545502 22216 tablet_service.cc:1467] Processing CreateTablet for tablet 4df7305890cf45e09b97668447a2218c (DEFAULT_TABLE table=test-table [id=9b50d1d2e9f644979091e891de136638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:12.546150 22216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df7305890cf45e09b97668447a2218c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.549814 22710 tablet_bootstrap.cc:492] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: Bootstrap starting.
I20260808 08:40:12.551234 22709 tablet_bootstrap.cc:492] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: Bootstrap starting.
I20260808 08:40:12.551815 22710 tablet_bootstrap.cc:654] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.552850 22743 ts_tablet_manager.cc:1918] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:12.553086 22709 tablet_bootstrap.cc:654] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.553098 22743 log.cc:1196] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/4b066dae529a4e9eb0e643952a51900e
I20260808 08:40:12.553754 22743 ts_tablet_manager.cc:1939] T 4b066dae529a4e9eb0e643952a51900e P d9075009b6814123b01eb89440ef0b76: Deleting consensus metadata
I20260808 08:40:12.556186 22018 catalog_manager.cc:4841] TS d9075009b6814123b01eb89440ef0b76 (127.19.242.193:33261): tablet 4b066dae529a4e9eb0e643952a51900e (table test-table [id=1014841e51204626875b95d5ff4a8ac7]) successfully deleted
I20260808 08:40:12.560977 22709 tablet_bootstrap.cc:492] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: No bootstrap required, opened a new log
I20260808 08:40:12.561203 22709 ts_tablet_manager.cc:1397] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20260808 08:40:12.561522 22710 tablet_bootstrap.cc:492] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: No bootstrap required, opened a new log
I20260808 08:40:12.561627 22711 tablet_bootstrap.cc:492] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: Bootstrap starting.
I20260808 08:40:12.561713 22710 ts_tablet_manager.cc:1397] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260808 08:40:12.562819 22710 raft_consensus.cc:348] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.563107 22710 raft_consensus.cc:374] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.563230 22710 raft_consensus.cc:729] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d089d20be747f195d083b3541eedc0, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.563660 22711 tablet_bootstrap.cc:654] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.563594 22710 consensus_queue.cc:260] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.563992 22709 raft_consensus.cc:348] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.564280 22709 raft_consensus.cc:374] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.564401 22709 raft_consensus.cc:729] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58103f5fdf1c45429f8e1face7801e92, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.564718 22709 consensus_queue.cc:260] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.565502 22710 ts_tablet_manager.cc:1428] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:12.568005 22711 tablet_bootstrap.cc:492] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: No bootstrap required, opened a new log
I20260808 08:40:12.568216 22711 ts_tablet_manager.cc:1397] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260808 08:40:12.569231 22711 raft_consensus.cc:348] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.569499 22711 raft_consensus.cc:374] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.569614 22711 raft_consensus.cc:729] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9075009b6814123b01eb89440ef0b76, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.570076 22709 ts_tablet_manager.cc:1428] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260808 08:40:12.569981 22711 consensus_queue.cc:260] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.571409 22711 ts_tablet_manager.cc:1428] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 08:40:12.676539 22718 raft_consensus.cc:482] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:12.676834 22718 raft_consensus.cc:504] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.678774 22718 leader_election.cc:288] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0d089d20be747f195d083b3541eedc0 (127.19.242.194:36813), 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843)
I20260808 08:40:12.688843 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.679648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:58849 (local address 127.19.242.194:36813)
0808 08:40:12.679869 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.679875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.680528 (+ 653us) server_negotiation.cc:407] Connection header received
0808 08:40:12.680986 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.680995 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.681117 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.681170 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:12.682115 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.683051 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.686099 (+ 3048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.687536 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.687737 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.687823 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.688317 (+ 494us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.688463 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 08:40:12.688941 22751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.679186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:36813 (local address 127.19.242.193:58849)
0808 08:40:12.680386 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.680412 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.680749 (+ 337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.681392 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.681396 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.681440 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:12.681926 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.681937 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.683212 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.683218 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.685877 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.685897 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.687839 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.687847 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.688063 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.688106 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.688281 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.688447 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1024,"mutex_wait_us":69,"spinlock_wait_cycles":13568,"thread_start_us":1272,"threads_started":1}
I20260808 08:40:12.689379 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.680064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:56965 (local address 127.19.242.195:33843)
0808 08:40:12.680252 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.680258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.680954 (+ 696us) server_negotiation.cc:407] Connection header received
0808 08:40:12.681086 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.681092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.681180 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.681289 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:12.682079 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.683275 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.686931 (+ 3656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.687850 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.688037 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.688203 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.688575 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.688734 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:40:12.689932 22441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df7305890cf45e09b97668447a2218c" candidate_uuid: "d9075009b6814123b01eb89440ef0b76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0d089d20be747f195d083b3541eedc0" is_pre_election: true
I20260808 08:40:12.690443 22750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.679303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33843 (local address 127.19.242.193:56965)
0808 08:40:12.680830 (+ 1527us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.680849 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.680966 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.681338 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.681343 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.681370 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:12.681854 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.681874 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.683431 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.683438 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.685882 (+ 2444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.685897 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.688117 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.688124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.688332 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.688380 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.689776 (+ 1396us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.689954 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1397,"mutex_wait_us":64,"thread_start_us":743,"threads_started":1}
I20260808 08:40:12.690618 22441 raft_consensus.cc:2454] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9075009b6814123b01eb89440ef0b76 in term 0.
I20260808 08:40:12.691279 22624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df7305890cf45e09b97668447a2218c" candidate_uuid: "d9075009b6814123b01eb89440ef0b76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58103f5fdf1c45429f8e1face7801e92" is_pre_election: true
I20260808 08:40:12.691408 22150 leader_election.cc:302] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0d089d20be747f195d083b3541eedc0, d9075009b6814123b01eb89440ef0b76; no voters:
I20260808 08:40:12.691561 22624 raft_consensus.cc:2454] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9075009b6814123b01eb89440ef0b76 in term 0.
I20260808 08:40:12.691941 22718 raft_consensus.cc:2781] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:12.692101 22718 raft_consensus.cc:482] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:12.692214 22718 raft_consensus.cc:3037] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.695542 22718 raft_consensus.cc:504] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.696394 22718 leader_election.cc:288] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [CANDIDATE]: Term 1 election: Requested vote from peers a0d089d20be747f195d083b3541eedc0 (127.19.242.194:36813), 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843)
I20260808 08:40:12.697042 22441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df7305890cf45e09b97668447a2218c" candidate_uuid: "d9075009b6814123b01eb89440ef0b76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0d089d20be747f195d083b3541eedc0"
I20260808 08:40:12.697085 22624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df7305890cf45e09b97668447a2218c" candidate_uuid: "d9075009b6814123b01eb89440ef0b76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58103f5fdf1c45429f8e1face7801e92"
I20260808 08:40:12.697293 22441 raft_consensus.cc:3037] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.697326 22624 raft_consensus.cc:3037] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.700193 22441 raft_consensus.cc:2454] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9075009b6814123b01eb89440ef0b76 in term 1.
I20260808 08:40:12.700562 22624 raft_consensus.cc:2454] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9075009b6814123b01eb89440ef0b76 in term 1.
I20260808 08:40:12.701014 22150 leader_election.cc:302] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0d089d20be747f195d083b3541eedc0, d9075009b6814123b01eb89440ef0b76; no voters:
I20260808 08:40:12.701383 22718 raft_consensus.cc:2781] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:12.701908 22718 raft_consensus.cc:686] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 1 LEADER]: Becoming Leader. State: Replica: d9075009b6814123b01eb89440ef0b76, State: Running, Role: LEADER
I20260808 08:40:12.702373 22718 consensus_queue.cc:237] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.706626 22034 catalog_manager.cc:5495] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9075009b6814123b01eb89440ef0b76 (127.19.242.193). New cstate: current_term: 1 leader_uuid: "d9075009b6814123b01eb89440ef0b76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:40:12 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178409, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:12.755690 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.737323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44295 (local address 127.0.0.1:33072)
0808 08:40:12.738156 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.738180 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.738362 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.738945 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.738950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.739873 (+ 923us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:12.740154 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.740169 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.741311 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.741318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.742904 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.742922 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.743753 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.743760 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.743958 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.744799 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:12.744825 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:12.747829 (+ 3004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:12.752296 (+ 4467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:12.752313 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:12.752319 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:12.753149 (+ 830us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:12.753683 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:12.753688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:12.753692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:12.753846 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:12.754452 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:12.754462 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:12.754673 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.754914 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.755249 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":447,"threads_started":1}
I20260808 08:40:12.755815 22763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.737323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33072 (local address 127.19.242.254:44295)
0808 08:40:12.738562 (+ 1239us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.738566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.738587 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:40:12.738643 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.738647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.738755 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.738863 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:12.740365 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.741144 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.743059 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.743563 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.743694 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.748099 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:12.748106 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:12.748111 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:12.748155 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:12.752064 (+ 3909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.753318 (+ 1254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.753325 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.753329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.753530 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:12.753966 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:12.753970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:12.753973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:12.754295 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:12.754450 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.755066 (+ 616us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.755445 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":146,"server-negotiator.queue_time_us":1135,"thread_start_us":967,"threads_started":1}
I20260808 08:40:12.762538 22032 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:33072:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:40:12.764005 22032 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:12.772439 22216 tablet_service.cc:1467] Processing CreateTablet for tablet c4dbf619bf5340468b730a651dee7926 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=872ebe262bf44cd2a87e0907cdb12a92]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:40:12.772683 22410 tablet_service.cc:1467] Processing CreateTablet for tablet c4dbf619bf5340468b730a651dee7926 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=872ebe262bf44cd2a87e0907cdb12a92]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:40:12.772743 22594 tablet_service.cc:1467] Processing CreateTablet for tablet c4dbf619bf5340468b730a651dee7926 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=872ebe262bf44cd2a87e0907cdb12a92]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:40:12.773190 22216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4dbf619bf5340468b730a651dee7926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.773298 22410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4dbf619bf5340468b730a651dee7926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.773325 22594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4dbf619bf5340468b730a651dee7926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:12.781836 22710 tablet_bootstrap.cc:492] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: Bootstrap starting.
I20260808 08:40:12.783075 22709 tablet_bootstrap.cc:492] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: Bootstrap starting.
I20260808 08:40:12.784072 22710 tablet_bootstrap.cc:654] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.785152 22709 tablet_bootstrap.cc:654] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.786309 22711 tablet_bootstrap.cc:492] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: Bootstrap starting.
I20260808 08:40:12.787132 22710 tablet_bootstrap.cc:492] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: No bootstrap required, opened a new log
I20260808 08:40:12.787351 22710 ts_tablet_manager.cc:1397] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260808 08:40:12.788185 22711 tablet_bootstrap.cc:654] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:12.788260 22710 raft_consensus.cc:348] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.788555 22710 raft_consensus.cc:374] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.788661 22710 raft_consensus.cc:729] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d089d20be747f195d083b3541eedc0, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.788957 22710 consensus_queue.cc:260] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.789695 22710 ts_tablet_manager.cc:1428] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:40:12.789940 22739 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.790417 22739 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:12.792658 22709 tablet_bootstrap.cc:492] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: No bootstrap required, opened a new log
I20260808 08:40:12.792903 22709 ts_tablet_manager.cc:1397] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260808 08:40:12.793716 22709 raft_consensus.cc:348] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.793967 22709 raft_consensus.cc:374] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.794076 22709 raft_consensus.cc:729] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58103f5fdf1c45429f8e1face7801e92, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.794350 22709 consensus_queue.cc:260] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.795018 22709 ts_tablet_manager.cc:1428] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 08:40:12.794946 22716 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.795382 22716 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:12.797552 22711 tablet_bootstrap.cc:492] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: No bootstrap required, opened a new log
I20260808 08:40:12.797781 22711 ts_tablet_manager.cc:1397] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260808 08:40:12.798789 22711 raft_consensus.cc:348] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.799077 22711 raft_consensus.cc:374] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:12.799166 22711 raft_consensus.cc:729] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9075009b6814123b01eb89440ef0b76, State: Initialized, Role: FOLLOWER
I20260808 08:40:12.799449 22711 consensus_queue.cc:260] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.799924 22718 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.800217 22718 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:12.801479 22711 ts_tablet_manager.cc:1428] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:12.841421 22739 raft_consensus.cc:482] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:12.841735 22739 raft_consensus.cc:504] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.842770 22739 leader_election.cc:288] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9075009b6814123b01eb89440ef0b76 (127.19.242.193:33261), 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843)
I20260808 08:40:12.843452 22245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4dbf619bf5340468b730a651dee7926" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9075009b6814123b01eb89440ef0b76" is_pre_election: true
I20260808 08:40:12.843765 22245 raft_consensus.cc:2454] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 0.
I20260808 08:40:12.844177 22624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4dbf619bf5340468b730a651dee7926" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58103f5fdf1c45429f8e1face7801e92" is_pre_election: true
I20260808 08:40:12.844365 22351 leader_election.cc:302] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0d089d20be747f195d083b3541eedc0, d9075009b6814123b01eb89440ef0b76; no voters:
I20260808 08:40:12.844501 22624 raft_consensus.cc:2454] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 0.
I20260808 08:40:12.844764 22739 raft_consensus.cc:2781] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:12.844900 22739 raft_consensus.cc:482] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:12.845018 22739 raft_consensus.cc:3037] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.848659 22739 raft_consensus.cc:504] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.849560 22739 leader_election.cc:288] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 election: Requested vote from peers d9075009b6814123b01eb89440ef0b76 (127.19.242.193:33261), 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843)
I20260808 08:40:12.850226 22245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4dbf619bf5340468b730a651dee7926" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9075009b6814123b01eb89440ef0b76"
I20260808 08:40:12.850310 22624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4dbf619bf5340468b730a651dee7926" candidate_uuid: "a0d089d20be747f195d083b3541eedc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58103f5fdf1c45429f8e1face7801e92"
I20260808 08:40:12.850486 22245 raft_consensus.cc:3037] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.850581 22624 raft_consensus.cc:3037] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:12.853937 22245 raft_consensus.cc:2454] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 1.
I20260808 08:40:12.854214 22624 raft_consensus.cc:2454] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d089d20be747f195d083b3541eedc0 in term 1.
I20260808 08:40:12.854637 22351 leader_election.cc:302] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0d089d20be747f195d083b3541eedc0, d9075009b6814123b01eb89440ef0b76; no voters:
I20260808 08:40:12.855113 22739 raft_consensus.cc:2781] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:12.855341 22739 raft_consensus.cc:686] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [term 1 LEADER]: Becoming Leader. State: Replica: a0d089d20be747f195d083b3541eedc0, State: Running, Role: LEADER
I20260808 08:40:12.855696 22739 consensus_queue.cc:237] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } }
I20260808 08:40:12.858265 22722 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: TxnStatusTablet state changed. Reason: New leader a0d089d20be747f195d083b3541eedc0. Latest consensus state: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.858680 22722 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:40:12.859906 22032 catalog_manager.cc:5495] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0d089d20be747f195d083b3541eedc0 (127.19.242.194). New cstate: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } health_report { overall_health: UNKNOWN } } }
I20260808 08:40:12.867090 22768 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:40:12.867626 22768 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:40:12.881690 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.876059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54568 (local address 127.19.242.194:36813)
0808 08:40:12.876306 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.876313 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.876510 (+ 197us) server_negotiation.cc:407] Connection header received
0808 08:40:12.876841 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.876845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.876922 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.877036 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:12.877444 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.878250 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.879683 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.880175 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.880341 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.880843 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:12.880963 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:12.881074 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.881266 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.881356 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:40:12.881736 22762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.876069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:36813 (local address 127.0.0.1:54568)
0808 08:40:12.876405 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.876423 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.876619 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.877074 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.877079 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.877090 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:12.877289 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.877298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.878402 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.878408 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.879516 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.879530 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.880363 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.880370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.880547 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.880617 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:12.881079 (+ 462us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:12.881118 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.881228 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.881404 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 08:40:12.886565 22245 raft_consensus.cc:1261] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Refusing update from remote peer a0d089d20be747f195d083b3541eedc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:12.886639 22624 raft_consensus.cc:1261] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Refusing update from remote peer a0d089d20be747f195d083b3541eedc0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:12.887295 22722 consensus_queue.cc:1035] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:12.887877 22739 consensus_queue.cc:1035] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:12.891606 22718 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: TxnStatusTablet state changed. Reason: New leader a0d089d20be747f195d083b3541eedc0. Latest consensus state: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.891943 22718 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:12.892135 22739 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.892455 22739 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:40:12.895349 22716 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: TxnStatusTablet state changed. Reason: New leader a0d089d20be747f195d083b3541eedc0. Latest consensus state: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.895694 22716 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:12.897841 22717 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.898231 22717 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P a0d089d20be747f195d083b3541eedc0: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:40:12.898545 22718 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.898900 22718 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P d9075009b6814123b01eb89440ef0b76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:12.902496 22716 tablet_replica.cc:439] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a0d089d20be747f195d083b3541eedc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9075009b6814123b01eb89440ef0b76" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33261 } } peers { permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 } } peers { permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 } } }
I20260808 08:40:12.902832 22716 tablet_replica.cc:442] T c4dbf619bf5340468b730a651dee7926 P 58103f5fdf1c45429f8e1face7801e92: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:12.913638 22774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.906403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44356 (local address 127.19.242.193:33261)
0808 08:40:12.907048 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.907053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.907073 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:40:12.907163 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.907166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.907260 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.907404 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:12.907886 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.908740 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.910846 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.911324 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.911453 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.912110 (+ 657us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:12.912800 (+ 690us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:12.912926 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.913129 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.913218 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":483,"threads_started":1}
I20260808 08:40:12.934413 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.927314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:43159 (local address 127.19.242.194:36813)
0808 08:40:12.927523 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.927528 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.928264 (+ 736us) server_negotiation.cc:407] Connection header received
0808 08:40:12.928540 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.928545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.928627 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.928739 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:12.929328 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.930225 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.932053 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.932564 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.932772 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.933450 (+ 678us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:12.933614 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:12.933772 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:12.933936 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 08:40:12.934034 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:40:12.934474 22778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.927298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:36813 (local address 127.19.242.193:43159)
0808 08:40:12.928030 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.928048 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.928363 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.928760 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.928766 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.928779 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:12.929135 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.929144 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.930446 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.930451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.931825 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.931862 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.933001 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.933007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:12.933146 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:12.933220 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:12.933776 (+ 556us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:12.933792 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 08:40:12.933903 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 08:40:12.934078 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":388,"threads_started":1}
I20260808 08:40:12.947614 22441 raft_consensus.cc:1261] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Refusing update from remote peer d9075009b6814123b01eb89440ef0b76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:12.948472 22624 raft_consensus.cc:1261] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Refusing update from remote peer d9075009b6814123b01eb89440ef0b76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:12.948678 22753 consensus_queue.cc:1035] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0d089d20be747f195d083b3541eedc0" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 36813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:12.949232 22718 consensus_queue.cc:1035] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58103f5fdf1c45429f8e1face7801e92" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:13.003495 22774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.996162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:35097 (local address 127.19.242.193:33261)
0808 08:40:12.996388 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:12.996394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:12.997342 (+ 948us) server_negotiation.cc:407] Connection header received
0808 08:40:12.997595 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:12.997601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:12.997681 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:12.997792 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:12.998377 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.999200 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.001223 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.001926 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.002067 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:13.002823 (+ 756us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:13.002938 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:13.003016 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:13.003189 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 08:40:13.003266 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:40:13.003872 22786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:12.995949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:33261 (local address 127.19.242.194:35097)
0808 08:40:12.997211 (+ 1262us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:12.997237 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:12.997429 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:12.997817 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:12.997822 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:12.997834 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:12.998202 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:12.998212 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:12.999360 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:12.999366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:13.001037 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:13.001052 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.002259 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.002267 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:13.002458 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:13.002551 (+ 93us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:13.003053 (+ 502us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:13.003073 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:40:13.003179 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:40:13.003363 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1021,"thread_start_us":837,"threads_started":1}
I20260808 08:40:13.053664 22032 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:13.053994 22032 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:13.058002 22032 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddf760adaa7548f7ae6a8194a4048ddd: Sending DeleteTablet for 3 replicas of tablet 4df7305890cf45e09b97668447a2218c
I20260808 08:40:13.059361 22594 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df7305890cf45e09b97668447a2218c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:13 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:43348
I20260808 08:40:13.059372 22410 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df7305890cf45e09b97668447a2218c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:13 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:54556
I20260808 08:40:13.060608 22216 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df7305890cf45e09b97668447a2218c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:13 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:44352
I20260808 08:40:13.073514 22795 tablet_replica.cc:330] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: stopping tablet replica
I20260808 08:40:13.073804 22795 raft_consensus.cc:2229] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:13.074488 22795 raft_consensus.cc:2258] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:13.080566 22795 ts_tablet_manager.cc:1905] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:13.084899 22794 tablet_replica.cc:330] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: stopping tablet replica
I20260808 08:40:13.085171 22794 raft_consensus.cc:2229] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:13.085461 22794 raft_consensus.cc:2258] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:13.088801 22791 tablet_replica.cc:330] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: stopping tablet replica
I20260808 08:40:13.089063 22791 raft_consensus.cc:2229] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:13.089367 22791 raft_consensus.cc:2258] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:13.094518 22795 ts_tablet_manager.cc:1918] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:13.094833 22795 log.cc:1196] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/4df7305890cf45e09b97668447a2218c
I20260808 08:40:13.095472 22795 ts_tablet_manager.cc:1939] T 4df7305890cf45e09b97668447a2218c P d9075009b6814123b01eb89440ef0b76: Deleting consensus metadata
I20260808 08:40:13.096925 22018 catalog_manager.cc:4841] TS d9075009b6814123b01eb89440ef0b76 (127.19.242.193:33261): tablet 4df7305890cf45e09b97668447a2218c (table test-table [id=9b50d1d2e9f644979091e891de136638]) successfully deleted
I20260808 08:40:13.099733 22794 ts_tablet_manager.cc:1905] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:13.102236 22791 ts_tablet_manager.cc:1905] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:13.108911 22794 ts_tablet_manager.cc:1918] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:13.115599 22794 log.cc:1196] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/4df7305890cf45e09b97668447a2218c
I20260808 08:40:13.116449 22794 ts_tablet_manager.cc:1939] T 4df7305890cf45e09b97668447a2218c P a0d089d20be747f195d083b3541eedc0: Deleting consensus metadata
I20260808 08:40:13.118029 22016 catalog_manager.cc:4841] TS a0d089d20be747f195d083b3541eedc0 (127.19.242.194:36813): tablet 4df7305890cf45e09b97668447a2218c (table test-table [id=9b50d1d2e9f644979091e891de136638]) successfully deleted
I20260808 08:40:13.132477 22791 ts_tablet_manager.cc:1918] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:13.136369 22791 log.cc:1196] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/4df7305890cf45e09b97668447a2218c
I20260808 08:40:13.137135 22791 ts_tablet_manager.cc:1939] T 4df7305890cf45e09b97668447a2218c P 58103f5fdf1c45429f8e1face7801e92: Deleting consensus metadata
I20260808 08:40:13.140758 22018 catalog_manager.cc:4841] TS 58103f5fdf1c45429f8e1face7801e92 (127.19.242.195:33843): tablet 4df7305890cf45e09b97668447a2218c (table test-table [id=9b50d1d2e9f644979091e891de136638]) successfully deleted
Aug 08 08:40:13 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:13.155340 22774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:13.101483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44366 (local address 127.19.242.193:33261)
0808 08:40:13.101723 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:13.101729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:13.119510 (+ 17781us) server_negotiation.cc:407] Connection header received
0808 08:40:13.119823 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:13.119829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:13.119935 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:13.120011 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:13.132879 (+ 12868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.134035 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.137380 (+ 3345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.138116 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.138230 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:13.146448 (+ 8218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:13.146472 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:13.146493 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:13.146572 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:13.151323 (+ 4751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.152628 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.152643 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.152647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.152901 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.153426 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.153431 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.153434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.153934 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:13.154348 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:13.154588 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 08:40:13.154894 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 08:40:13.156246 22308 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44366
I20260808 08:40:13.175158 22763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:13.159759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33088 (local address 127.19.242.254:44295)
0808 08:40:13.160034 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:13.160042 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:13.160620 (+ 578us) server_negotiation.cc:407] Connection header received
0808 08:40:13.160891 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:13.160898 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:13.160980 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:13.161093 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:13.162821 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.163571 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.164902 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.165364 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.165522 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:13.168543 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:13.168548 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:13.168551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:13.168594 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:13.171931 (+ 3337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.172916 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.172929 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.172932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.173073 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.173516 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.173523 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.173530 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.173853 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:13.174136 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:13.174501 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 08:40:13.174812 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
W20260808 08:40:13.176046 22032 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33088
I20260808 08:40:13.178119 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22129
I20260808 08:40:13.198503 22774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:13.180162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44382 (local address 127.19.242.193:33261)
0808 08:40:13.181118 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:13.181128 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:13.182492 (+ 1364us) server_negotiation.cc:407] Connection header received
0808 08:40:13.182761 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:13.182767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:13.182859 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:13.182984 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:13.184256 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.186232 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.187558 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.188044 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.188193 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:13.191255 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:13.191278 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:13.191288 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:13.191357 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:13.195198 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.196100 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.196105 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.196114 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.196280 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.196737 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.196742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.196747 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.197079 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:13.197396 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:13.197754 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:40:13.198050 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756}
W20260808 08:40:13.199213 22308 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44382
W20260808 08:40:13.199865 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22129: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:13.200091 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 22129
I20260808 08:40:13.235812 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22324
Aug 08 08:40:13 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:13.257103 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:13.236762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54578 (local address 127.19.242.194:36813)
0808 08:40:13.236978 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:13.236984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:13.237078 (+ 94us) server_negotiation.cc:407] Connection header received
0808 08:40:13.237260 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:13.237266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:13.237354 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:13.237479 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:13.238996 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.240224 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.241775 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.242535 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.242735 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:13.248452 (+ 5717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:13.248475 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:13.248499 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:13.248559 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:13.253263 (+ 4704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.254315 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.254330 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.254339 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.254535 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.255125 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.255132 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.255136 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.255703 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:13.256079 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:13.256429 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 08:40:13.256739 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 08:40:13.258050 22502 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54578
W20260808 08:40:13.258944 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22324: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:13.259172 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 22324
I20260808 08:40:13.295025 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22512
Aug 08 08:40:13 dist-test-slave-39l8 krb5kdc[21971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:13.312789 22809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:13.296084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43356 (local address 127.19.242.195:33843)
0808 08:40:13.296580 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:13.296586 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:13.296605 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:40:13.296662 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:13.296665 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:13.296735 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:13.296864 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:13.298246 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.299171 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.300458 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:13.300918 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:13.301081 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:13.306032 (+ 4951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:13.306050 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:13.306069 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:13.306128 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:13.309511 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.310440 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.310448 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.310451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.310614 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:13.311061 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:13.311070 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:13.311072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:13.311471 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:13.311804 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:13.312160 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 08:40:13.312432 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":229,"threads_started":1}
W20260808 08:40:13.313551 22675 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43356
W20260808 08:40:13.314343 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22512: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:13.314561 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 22512
I20260808 08:40:13.343073 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21992
I20260808 08:40:13.344403 22089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:13.467826 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21992
2026-08-08T08:40:13Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5427 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:13 dist-test-slave-39l8 krb5kdc[22816](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:13 dist-test-slave-39l8 krb5kdc[22816](info): set up 2 sockets
Aug 08 08:40:13 dist-test-slave-39l8 krb5kdc[22816](info): commencing operation
krb5kdc: starting...
W20260808 08:40:14.818087 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.290s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:14 dist-test-slave-39l8 krb5kdc[22816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:15.064782 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:45969
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:45969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:15.446399 22830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:15.446798 22830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:15.446977 22830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:15.455458 22830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:15.455600 22830 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:40:15.455706 22830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:15.455843 22830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:15.455930 22830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:15.456049 22830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:15.467777 22830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:45969
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:45969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:15.469363 22830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:15.470935 22830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:15.484958 22843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:15.484999 22835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:15.485054 22836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:15.486038 22830 server_base.cc:1034] running on GCE node
I20260808 08:40:15.486984 22830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:15.488608 22830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:15.489916 22830 hybrid_clock.cc:648] HybridClock initialized: now 1786178415489829 us; error 52 us; skew 500 ppm
I20260808 08:40:15.490386 22830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:15 dist-test-slave-39l8 krb5kdc[22816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178415, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:15.498836 22830 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:15.500708 22830 webserver.cc:460] Webserver started at http://127.19.242.254:45949/ using document root <none> and password file <none>
I20260808 08:40:15.501554 22830 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:15.501729 22830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:15.502090 22830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:15.506732 22830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "e9c00633874f4448ac4aa4725b00b26b"
format_stamp: "Formatted at 2026-08-08 08:40:15 on dist-test-slave-39l8"
server_key: "9ec68409a71dba33c62831ed03d0bf62"
server_key_iv: "edcc9bf43d0d1c59df8344bbf06876bc"
server_key_version: "encryptionkey@0"
I20260808 08:40:15.508057 22830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "e9c00633874f4448ac4aa4725b00b26b"
format_stamp: "Formatted at 2026-08-08 08:40:15 on dist-test-slave-39l8"
server_key: "9ec68409a71dba33c62831ed03d0bf62"
server_key_iv: "edcc9bf43d0d1c59df8344bbf06876bc"
server_key_version: "encryptionkey@0"
I20260808 08:40:15.517100 22830 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260808 08:40:15.521421 22851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:15.523083 22830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:15.523253 22830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "e9c00633874f4448ac4aa4725b00b26b"
format_stamp: "Formatted at 2026-08-08 08:40:15 on dist-test-slave-39l8"
server_key: "9ec68409a71dba33c62831ed03d0bf62"
server_key_iv: "edcc9bf43d0d1c59df8344bbf06876bc"
server_key_version: "encryptionkey@0"
I20260808 08:40:15.523456 22830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:15.553798 22830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:15.558307 22830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:15.558557 22830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:15.582350 22830 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:45969
I20260808 08:40:15.582369 22934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:45969 every 8 connection(s)
I20260808 08:40:15.583935 22830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:15.588287 22935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:15.592063 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 22830
I20260808 08:40:15.592309 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:15.593207 20427 external_mini_cluster.cc:1428] Setting key b4ecae238d379019ec021bc729fa9548
I20260808 08:40:15.603341 22935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Bootstrap starting.
I20260808 08:40:15.607717 22935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:15.609277 22935 log.cc:824] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:40:15 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:15.613289 22935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: No bootstrap required, opened a new log
I20260808 08:40:15.620751 22938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:15.595671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36056 (local address 127.19.242.254:45969)
0808 08:40:15.596567 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:15.596580 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:15.596626 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:40:15.598393 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:15.598421 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:15.598968 (+ 547us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:15.599365 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:15.601421 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:15.603141 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:15.605027 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:15.605893 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:15.606057 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:15.611961 (+ 5904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:15.611970 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:15.611989 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:15.612047 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:15.615699 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:15.616725 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:15.616739 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:15.616770 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:15.616981 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:15.617476 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:15.617480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:15.617482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:15.618136 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:15.618379 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:15.619019 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 08:40:15.619544 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":430,"threads_started":1}
I20260808 08:40:15.622603 22935 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9c00633874f4448ac4aa4725b00b26b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 45969 } }
I20260808 08:40:15.623083 22935 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:15.623193 22935 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9c00633874f4448ac4aa4725b00b26b, State: Initialized, Role: FOLLOWER
I20260808 08:40:15.623814 22935 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9c00633874f4448ac4aa4725b00b26b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 45969 } }
I20260808 08:40:15.624095 22935 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:15.624264 22935 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:15.624449 22935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:15.626770 22935 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9c00633874f4448ac4aa4725b00b26b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 45969 } }
I20260808 08:40:15.627420 22935 leader_election.cc:302] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9c00633874f4448ac4aa4725b00b26b; no voters:
I20260808 08:40:15.628055 22935 leader_election.cc:288] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:15.628450 22941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:15.629603 22941 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [term 1 LEADER]: Becoming Leader. State: Replica: e9c00633874f4448ac4aa4725b00b26b, State: Running, Role: LEADER
I20260808 08:40:15.630225 22941 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9c00633874f4448ac4aa4725b00b26b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 45969 } }
I20260808 08:40:15.630823 22935 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:15.633363 22942 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9c00633874f4448ac4aa4725b00b26b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9c00633874f4448ac4aa4725b00b26b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 45969 } } }
I20260808 08:40:15.633904 22942 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:15.635279 22943 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9c00633874f4448ac4aa4725b00b26b. Latest consensus state: current_term: 1 leader_uuid: "e9c00633874f4448ac4aa4725b00b26b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9c00633874f4448ac4aa4725b00b26b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 45969 } } }
I20260808 08:40:15.635571 22943 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:15.640342 22954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:15.645257 22954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:15.655771 22954 catalog_manager.cc:1347] Generated new cluster ID: d3b05cb037504f3badcc53a031434f81
I20260808 08:40:15.655923 22954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:15.672979 22954 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:15.674461 22954 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:15.686787 22954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Generated new TSK 0
I20260808 08:40:15.687749 22954 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:15.750815 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:45969
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:16.124876 22970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:16.125214 22970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:16.125389 22970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:16.133430 22970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:16.133600 22970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:16.133708 22970 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:40:16.133764 22970 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:40:16.133836 22970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:16.144513 22970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:45969
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:16.145961 22970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:16.147437 22970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:16.162081 22975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:16.162252 22978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:16.162322 22976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:16.163509 22970 server_base.cc:1034] running on GCE node
I20260808 08:40:16.164366 22970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:16.165586 22970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:16.166886 22970 hybrid_clock.cc:648] HybridClock initialized: now 1786178416166843 us; error 37 us; skew 500 ppm
I20260808 08:40:16.167291 22970 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:16 dist-test-slave-39l8 krb5kdc[22816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178416, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:16.171526 22970 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:16.173380 22970 webserver.cc:460] Webserver started at http://127.19.242.193:43767/ using document root <none> and password file <none>
I20260808 08:40:16.174207 22970 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:16.174361 22970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:16.174774 22970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:16.178213 22970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "4de58e9a195b4796bf9f059317bca726"
format_stamp: "Formatted at 2026-08-08 08:40:16 on dist-test-slave-39l8"
server_key: "54e8d1710196da6bca429f44a5b5e982"
server_key_iv: "210fc4a5effb2946046abbea57969de9"
server_key_version: "encryptionkey@0"
I20260808 08:40:16.179137 22970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "4de58e9a195b4796bf9f059317bca726"
format_stamp: "Formatted at 2026-08-08 08:40:16 on dist-test-slave-39l8"
server_key: "54e8d1710196da6bca429f44a5b5e982"
server_key_iv: "210fc4a5effb2946046abbea57969de9"
server_key_version: "encryptionkey@0"
I20260808 08:40:16.185189 22970 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:40:16.189564 22986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:16.191210 22970 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:16.191442 22970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "4de58e9a195b4796bf9f059317bca726"
format_stamp: "Formatted at 2026-08-08 08:40:16 on dist-test-slave-39l8"
server_key: "54e8d1710196da6bca429f44a5b5e982"
server_key_iv: "210fc4a5effb2946046abbea57969de9"
server_key_version: "encryptionkey@0"
I20260808 08:40:16.191661 22970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:16.211714 22970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:16.216678 22970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:16.217022 22970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:16.220202 22970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:16.220348 22970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:16.220481 22970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:16.220597 22970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:40:16 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178416, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:16.246671 23000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.220792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:56543 (local address 127.19.242.254:45969)
0808 08:40:16.221689 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:16.221694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:16.222608 (+ 914us) server_negotiation.cc:407] Connection header received
0808 08:40:16.224788 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:16.224793 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:16.224908 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:16.225036 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:16.227654 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.228730 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.230491 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.231071 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.231254 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.237399 (+ 6145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:16.237410 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:16.237417 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:16.237479 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:16.241207 (+ 3728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.242755 (+ 1548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.242762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.242765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.242942 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.243722 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.243733 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.243739 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.244217 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:16.244406 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:16.245632 (+ 1226us) server_negotiation.cc:299] Negotiation successful
0808 08:40:16.246023 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":679,"threads_started":1}
I20260808 08:40:16.247362 23001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.221542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:45969 (local address 127.19.242.193:56543)
0808 08:40:16.222416 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:16.222459 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:16.224450 (+ 1991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:16.225311 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:16.225320 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:16.226211 (+ 891us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:16.227433 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.227470 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.228922 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.228928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.230313 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.230327 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.231481 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.231499 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.231960 (+ 461us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.233093 (+ 1133us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:16.233155 (+ 62us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:16.237075 (+ 3920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:16.241471 (+ 4396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.241483 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.241505 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.242479 (+ 974us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.243085 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.243091 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.243094 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.243513 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.244396 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:16.244422 (+ 26us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:16.244999 (+ 577us) client_negotiation.cc:769] Sending connection context
0808 08:40:16.245410 (+ 411us) client_negotiation.cc:240] Negotiation successful
0808 08:40:16.245945 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":373,"threads_started":1}
I20260808 08:40:16.277758 23000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.258342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:36769 (local address 127.19.242.254:45969)
0808 08:40:16.258591 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:16.258599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:16.259940 (+ 1341us) server_negotiation.cc:407] Connection header received
0808 08:40:16.260108 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:16.260119 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:16.260250 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:16.260418 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:16.261620 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.263211 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.265833 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.266943 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.267135 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.270120 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:16.270127 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:16.270130 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:16.270171 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:16.273749 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.275051 (+ 1302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.275058 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.275063 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.275274 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.275906 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.275915 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.275920 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.276392 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:16.276580 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:16.277073 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 08:40:16.277356 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:40:16.277913 23081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.258413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:45969 (local address 127.19.242.193:36769)
0808 08:40:16.259774 (+ 1361us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:16.259797 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:16.259962 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:16.260478 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:16.260482 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:16.261007 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:16.261422 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.261433 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.263435 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.263442 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.265487 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.265510 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.267271 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.267281 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.267454 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.268326 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:16.268365 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:16.269829 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:16.273944 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.273951 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.273956 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.274858 (+ 902us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.275469 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.275481 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.275488 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.275726 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.276552 (+ 826us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:16.276558 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:16.276778 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 08:40:16.276949 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 08:40:16.277348 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1199,"thread_start_us":1035,"threads_started":1}
I20260808 08:40:16.287815 22970 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:41853
I20260808 08:40:16.287833 23148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:41853 every 8 connection(s)
I20260808 08:40:16.289193 22970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:16.291594 23149 heartbeater.cc:347] Connected to a master server at 127.19.242.254:45969
I20260808 08:40:16.291929 23149 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:16.292714 23149 heartbeater.cc:511] Master 127.19.242.254:45969 requested a full tablet report, sending...
I20260808 08:40:16.295375 22870 ts_manager.cc:194] Registered new tserver with Master: 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853)
I20260808 08:40:16.297173 22870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:56543
I20260808 08:40:16.298396 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 22970
I20260808 08:40:16.298646 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:16.299412 20427 external_mini_cluster.cc:1428] Setting key 7ec2fb5b2bbcf041e068b56e8f9fc3a8
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:16.354293 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:45969
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:16.738227 23157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:16.738955 23157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:16.739194 23157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:16.757555 23157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:16.757790 23157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:16.758000 23157 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:40:16.758109 23157 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:40:16.758255 23157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:16.781322 23157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:45969
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:16.783377 23157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:16.785485 23157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:16.807587 23163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:16.808808 23162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:16.808863 23165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:16.810513 23157 server_base.cc:1034] running on GCE node
I20260808 08:40:16.811604 23157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:16.813133 23157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:16.814442 23157 hybrid_clock.cc:648] HybridClock initialized: now 1786178416814359 us; error 123 us; skew 500 ppm
I20260808 08:40:16.814960 23157 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:16 dist-test-slave-39l8 krb5kdc[22816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178416, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:16.819921 23157 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:16.822022 23157 webserver.cc:460] Webserver started at http://127.19.242.194:38795/ using document root <none> and password file <none>
I20260808 08:40:16.823035 23157 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:16.823215 23157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:16.823612 23157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:16.827633 23157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "96495451785940faae778d1e15166296"
format_stamp: "Formatted at 2026-08-08 08:40:16 on dist-test-slave-39l8"
server_key: "f29cf5ccd03b6d975e819db92cd56544"
server_key_iv: "2754c4fca1b0fc00364ba8c7d6ddab73"
server_key_version: "encryptionkey@0"
I20260808 08:40:16.828785 23157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "96495451785940faae778d1e15166296"
format_stamp: "Formatted at 2026-08-08 08:40:16 on dist-test-slave-39l8"
server_key: "f29cf5ccd03b6d975e819db92cd56544"
server_key_iv: "2754c4fca1b0fc00364ba8c7d6ddab73"
server_key_version: "encryptionkey@0"
I20260808 08:40:16.836043 23157 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260808 08:40:16.840575 23174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:16.842387 23157 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:40:16.842628 23157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "96495451785940faae778d1e15166296"
format_stamp: "Formatted at 2026-08-08 08:40:16 on dist-test-slave-39l8"
server_key: "f29cf5ccd03b6d975e819db92cd56544"
server_key_iv: "2754c4fca1b0fc00364ba8c7d6ddab73"
server_key_version: "encryptionkey@0"
I20260808 08:40:16.842976 23157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:16.862234 23157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:16.869345 23157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:16.869763 23157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:16.874609 23157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:16.874797 23157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 08:40:16.874939 23157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:16.875028 23157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:40:16 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178416, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:16.918277 23187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.874460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:58985 (local address 127.19.242.254:45969)
0808 08:40:16.890923 (+ 16463us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:16.890929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:16.890951 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:40:16.891054 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:16.891060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:16.891203 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:16.892692 (+ 1489us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:16.894439 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.895925 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.900274 (+ 4349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.901362 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.901564 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.907930 (+ 6366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:16.907941 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:16.907949 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:16.908015 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:16.912426 (+ 4411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.913976 (+ 1550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.913986 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.913990 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.914204 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.915236 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.915244 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.915247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.915778 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:16.916757 (+ 979us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:16.917560 (+ 803us) server_negotiation.cc:299] Negotiation successful
0808 08:40:16.917848 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16328,"thread_start_us":16178,"threads_started":1}
I20260808 08:40:16.920292 23189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.875472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:45969 (local address 127.19.242.194:58985)
0808 08:40:16.885591 (+ 10119us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:16.885679 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:16.889794 (+ 4115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:16.891713 (+ 1919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:16.891724 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:16.892705 (+ 981us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:16.893876 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.894085 (+ 209us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.896233 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.896243 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.899884 (+ 3641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.899922 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.901702 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.901712 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.902214 (+ 502us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.903350 (+ 1136us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:16.903392 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:16.907588 (+ 4196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:16.912728 (+ 5140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.912745 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.912772 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.913724 (+ 952us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.914531 (+ 807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.914540 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.914543 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.915035 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.916009 (+ 974us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:16.916024 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:16.916932 (+ 908us) client_negotiation.cc:769] Sending connection context
0808 08:40:16.917426 (+ 494us) client_negotiation.cc:240] Negotiation successful
0808 08:40:16.918066 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9733,"thread_start_us":9375,"threads_started":1}
I20260808 08:40:16.947131 23187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.926981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:48523 (local address 127.19.242.254:45969)
0808 08:40:16.927276 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:16.927286 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:16.933651 (+ 6365us) server_negotiation.cc:407] Connection header received
0808 08:40:16.933998 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:16.934003 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:16.934083 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:16.934262 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:16.935661 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.936393 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.937809 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.938251 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.938402 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.940820 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:16.940826 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:16.940829 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:16.940868 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:16.944015 (+ 3147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.944893 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.944900 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.944905 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.945083 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:16.945504 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:16.945510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:16.945513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:16.945880 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:16.946049 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:16.946492 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 08:40:16.946768 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:40:16.947247 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:16.926951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:45969 (local address 127.19.242.194:48523)
0808 08:40:16.933476 (+ 6525us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:16.933505 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:16.933818 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:16.934466 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:16.934469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:16.935132 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:16.935469 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.935481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.936554 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.936560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.937639 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:16.937652 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:16.938465 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:16.938472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:16.938725 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:16.939661 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:16.939694 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:16.940579 (+ 885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:16.944212 (+ 3633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.944218 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.944222 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.944730 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.945222 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:16.945228 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:16.945231 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:16.945378 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:16.946011 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:16.946016 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:16.946231 (+ 215us) client_negotiation.cc:769] Sending connection context
0808 08:40:16.946378 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 08:40:16.946788 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6287,"thread_start_us":6080,"threads_started":1}
I20260808 08:40:16.972430 23337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:39463 every 8 connection(s)
I20260808 08:40:16.972440 23157 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:39463
I20260808 08:40:16.974624 23157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:16.976034 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 23157
I20260808 08:40:16.976257 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:16.976861 20427 external_mini_cluster.cc:1428] Setting key d8b6dfe6fa1147bd74abb79306ff4f6e
I20260808 08:40:16.977607 23338 heartbeater.cc:347] Connected to a master server at 127.19.242.254:45969
I20260808 08:40:16.977922 23338 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:16.978950 23338 heartbeater.cc:511] Master 127.19.242.254:45969 requested a full tablet report, sending...
I20260808 08:40:16.980599 22870 ts_manager.cc:194] Registered new tserver with Master: 96495451785940faae778d1e15166296 (127.19.242.194:39463)
I20260808 08:40:16.981945 22870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:58985
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:17.036729 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:45969
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:40:17.300843 23149 heartbeater.cc:503] Master 127.19.242.254:45969 was elected leader, sending a full tablet report...
W20260808 08:40:17.411962 23342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:17.412412 23342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:17.412631 23342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:17.421046 23342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:17.421260 23342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:17.421487 23342 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:40:17.421608 23342 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:40:17.421787 23342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:17.434439 23342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:45969
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:17.436008 23342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:17.437494 23342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:17.452978 23351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:17.452943 23352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:17.453733 23355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:17.454347 23342 server_base.cc:1034] running on GCE node
I20260808 08:40:17.455281 23342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:17.456411 23342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:17.457657 23342 hybrid_clock.cc:648] HybridClock initialized: now 1786178417457597 us; error 57 us; skew 500 ppm
I20260808 08:40:17.458065 23342 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:17 dist-test-slave-39l8 krb5kdc[22816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178417, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:17.461794 23342 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:17.463716 23342 webserver.cc:460] Webserver started at http://127.19.242.195:37911/ using document root <none> and password file <none>
I20260808 08:40:17.464488 23342 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:17.464609 23342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:17.464917 23342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:17.468333 23342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "37be5733720340cb87e675d9bc94ac49"
format_stamp: "Formatted at 2026-08-08 08:40:17 on dist-test-slave-39l8"
server_key: "459e3f763daeffc491b5614593320078"
server_key_iv: "ec67130772007955c5208715c58d928a"
server_key_version: "encryptionkey@0"
I20260808 08:40:17.469189 23342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "37be5733720340cb87e675d9bc94ac49"
format_stamp: "Formatted at 2026-08-08 08:40:17 on dist-test-slave-39l8"
server_key: "459e3f763daeffc491b5614593320078"
server_key_iv: "ec67130772007955c5208715c58d928a"
server_key_version: "encryptionkey@0"
I20260808 08:40:17.475306 23342 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:40:17.479341 23364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:17.480988 23342 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:40:17.481225 23342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "37be5733720340cb87e675d9bc94ac49"
format_stamp: "Formatted at 2026-08-08 08:40:17 on dist-test-slave-39l8"
server_key: "459e3f763daeffc491b5614593320078"
server_key_iv: "ec67130772007955c5208715c58d928a"
server_key_version: "encryptionkey@0"
I20260808 08:40:17.481469 23342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:17.499356 23342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:17.504262 23342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:17.504598 23342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:17.507861 23342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:17.508018 23342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:17.508221 23342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:17.508349 23342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:40:17 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178417, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:17.535298 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.508402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:36293 (local address 127.19.242.254:45969)
0808 08:40:17.508950 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:17.508958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:17.510191 (+ 1233us) server_negotiation.cc:407] Connection header received
0808 08:40:17.512487 (+ 2296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:17.512493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:17.512606 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:17.512736 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:17.515278 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.516298 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.520065 (+ 3767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.521172 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.521376 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.526864 (+ 5488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:17.526872 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:17.526879 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:17.526949 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:17.531281 (+ 4332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:17.532380 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:17.532386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:17.532390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:17.532554 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:17.533106 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:17.533111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:17.533115 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:17.533439 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:17.533609 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:17.534522 (+ 913us) server_negotiation.cc:299] Negotiation successful
0808 08:40:17.534820 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":257,"threads_started":1}
I20260808 08:40:17.536413 23375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.509124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:45969 (local address 127.19.242.195:36293)
0808 08:40:17.509989 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:17.510036 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:17.512147 (+ 2111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:17.513076 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:17.513093 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:17.514045 (+ 952us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:17.515054 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.515077 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.516524 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.516537 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.519849 (+ 3312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.519870 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.521529 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.521541 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.521800 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.522846 (+ 1046us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:17.522893 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:17.526438 (+ 3545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:17.531535 (+ 5097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:17.531555 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:17.531588 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:17.532204 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:17.532685 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:17.532690 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:17.532694 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:17.532929 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:17.533584 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:17.533594 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:17.534052 (+ 458us) client_negotiation.cc:769] Sending connection context
0808 08:40:17.534373 (+ 321us) client_negotiation.cc:240] Negotiation successful
0808 08:40:17.535033 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":375,"threads_started":1}
I20260808 08:40:17.560259 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.544144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:45969 (local address 127.19.242.195:49633)
0808 08:40:17.544956 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:17.544974 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:17.545158 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:17.545535 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:17.545539 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:17.546029 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:17.546348 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.546359 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.547644 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.547649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.549261 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.549275 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.550210 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.550218 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.550425 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.551224 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:17.551258 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:17.552443 (+ 1185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:17.556408 (+ 3965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:17.556414 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:17.556419 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:17.556915 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:17.557354 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:17.557366 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:17.557368 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:17.557506 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:17.558245 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:17.558250 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:17.559081 (+ 831us) client_negotiation.cc:769] Sending connection context
0808 08:40:17.559308 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 08:40:17.559677 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":379,"threads_started":1}
I20260808 08:40:17.561151 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.543888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:49633 (local address 127.19.242.254:45969)
0808 08:40:17.544103 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:17.544110 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:17.545080 (+ 970us) server_negotiation.cc:407] Connection header received
0808 08:40:17.545323 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:17.545327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:17.545396 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:17.545504 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:17.546508 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.547490 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.549443 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.549996 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.550146 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.552657 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:17.552663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:17.552670 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:17.552713 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:17.556249 (+ 3536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:17.557064 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:17.557070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:17.557074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:17.557220 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:17.557645 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:17.557652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:17.557655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:17.558103 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:17.558298 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:17.560675 (+ 2377us) server_negotiation.cc:299] Negotiation successful
0808 08:40:17.560905 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:40:17.576274 23342 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:38099
I20260808 08:40:17.576326 23533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:38099 every 8 connection(s)
I20260808 08:40:17.577872 23342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:17.580860 23534 heartbeater.cc:347] Connected to a master server at 127.19.242.254:45969
I20260808 08:40:17.581177 23534 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:17.582007 23534 heartbeater.cc:511] Master 127.19.242.254:45969 requested a full tablet report, sending...
I20260808 08:40:17.583670 22870 ts_manager.cc:194] Registered new tserver with Master: 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099)
I20260808 08:40:17.584890 22870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:36293
I20260808 08:40:17.587436 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 23342
I20260808 08:40:17.587626 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:17.588191 20427 external_mini_cluster.cc:1428] Setting key 6fb4155c1784d5eebb9f4b6fb9182a52
I20260808 08:40:17.591995 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:40:17 dist-test-slave-39l8 krb5kdc[22816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:40:17 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:17.653826 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.637319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.19.242.254:45969)
0808 08:40:17.637587 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:17.637595 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:17.637841 (+ 246us) server_negotiation.cc:407] Connection header received
0808 08:40:17.638090 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:17.638095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:17.638198 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:17.638356 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:17.640061 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.640808 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.642125 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.642573 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.642750 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.647340 (+ 4590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:17.647346 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:17.647350 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:17.647396 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:17.651041 (+ 3645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:17.651946 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:17.651951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:17.651954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:17.652131 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:17.652572 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:17.652576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:17.652579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:17.652881 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:17.653088 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:17.653379 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:40:17.653562 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:40:17.658821 22870 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:17.666193 22870 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:17.697402 23555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.681075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55386 (local address 127.19.242.195:38099)
0808 08:40:17.682318 (+ 1243us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:17.682325 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:17.682355 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:40:17.682501 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:17.682508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:17.682835 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:17.683072 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:17.685932 (+ 2860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.690220 (+ 4288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.694227 (+ 4007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.695989 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.696195 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.696412 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:17.696835 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 08:40:17.697029 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1072,"thread_start_us":892,"threads_started":1}
I20260808 08:40:17.697702 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.680866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38099 (local address 127.0.0.1:55386)
0808 08:40:17.682051 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:17.682091 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:17.682298 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:17.683424 (+ 1126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:17.683435 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:17.683468 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:17.685605 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.685629 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.690483 (+ 4854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.690493 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.693945 (+ 3452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.693961 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.696216 (+ 2255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.696222 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.696471 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.696544 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 08:40:17.696779 (+ 235us) client_negotiation.cc:240] Negotiation successful
0808 08:40:17.697242 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"mutex_wait_us":68,"thread_start_us":728,"threads_started":1}
I20260808 08:40:17.701292 23559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.683262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:41853 (local address 127.0.0.1:49792)
0808 08:40:17.692422 (+ 9160us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:17.692444 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:17.692623 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:17.693661 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:17.693666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:17.693693 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:17.694246 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.694264 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.695903 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.695910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.698777 (+ 2867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.698792 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.700380 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.700387 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.700554 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.700596 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:40:17.700720 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 08:40:17.700881 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8980,"mutex_wait_us":63,"thread_start_us":8881,"threads_started":1}
I20260808 08:40:17.701272 23560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.683914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.19.242.193:41853)
0808 08:40:17.692072 (+ 8158us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:17.692087 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:17.692577 (+ 490us) server_negotiation.cc:407] Connection header received
0808 08:40:17.692868 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:17.692878 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:17.693198 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:17.693429 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:17.694448 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.695685 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.698987 (+ 3302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.700151 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.700366 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.700554 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:17.700792 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 08:40:17.700954 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7842,"thread_start_us":7639,"threads_started":1}
I20260808 08:40:17.701676 23437 tablet_service.cc:1467] Processing CreateTablet for tablet 55b97ffab72f4d6e961b3cafc877f915 (DEFAULT_TABLE table=test-table [id=94e92110b763428d814b2d91e2917275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:17.703481 23437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b97ffab72f4d6e961b3cafc877f915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:17.704239 23558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.682844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40114 (local address 127.19.242.194:39463)
0808 08:40:17.693074 (+ 10230us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:17.693085 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:17.693115 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:40:17.693223 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:17.693230 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:17.693471 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:17.694491 (+ 1020us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:17.694765 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.696218 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.698937 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.703069 (+ 4132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.703279 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.703449 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:17.703772 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 08:40:17.703950 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10073,"thread_start_us":9935,"threads_started":1}
I20260808 08:40:17.704277 23557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:17.682495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:39463 (local address 127.0.0.1:40114)
0808 08:40:17.683216 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:17.683241 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:17.683378 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:17.693720 (+ 10342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:17.693725 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:17.693759 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:17.694302 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.694314 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.696394 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.696400 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.698694 (+ 2294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:17.698738 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:17.703336 (+ 4598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:17.703346 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:17.703568 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:17.703603 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:40:17.703706 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:40:17.703857 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":27,"thread_start_us":341,"threads_started":1}
I20260808 08:40:17.705339 23055 tablet_service.cc:1467] Processing CreateTablet for tablet 55b97ffab72f4d6e961b3cafc877f915 (DEFAULT_TABLE table=test-table [id=94e92110b763428d814b2d91e2917275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:17.706934 23055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b97ffab72f4d6e961b3cafc877f915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:17.708451 23243 tablet_service.cc:1467] Processing CreateTablet for tablet 55b97ffab72f4d6e961b3cafc877f915 (DEFAULT_TABLE table=test-table [id=94e92110b763428d814b2d91e2917275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:17.709955 23243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55b97ffab72f4d6e961b3cafc877f915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:17.718609 23561 tablet_bootstrap.cc:492] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Bootstrap starting.
I20260808 08:40:17.722375 23561 tablet_bootstrap.cc:654] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:17.723834 23561 log.cc:824] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:17.725944 23562 tablet_bootstrap.cc:492] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Bootstrap starting.
I20260808 08:40:17.727245 23561 tablet_bootstrap.cc:492] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: No bootstrap required, opened a new log
I20260808 08:40:17.727560 23561 ts_tablet_manager.cc:1397] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260808 08:40:17.731194 23562 tablet_bootstrap.cc:654] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:17.731613 23564 tablet_bootstrap.cc:492] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Bootstrap starting.
I20260808 08:40:17.732805 23562 log.cc:824] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:17.736330 23564 tablet_bootstrap.cc:654] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:17.737082 23562 tablet_bootstrap.cc:492] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: No bootstrap required, opened a new log
I20260808 08:40:17.737397 23562 ts_tablet_manager.cc:1397] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 08:40:17.737800 23564 log.cc:824] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:17.738009 23561 raft_consensus.cc:348] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:17.738580 23561 raft_consensus.cc:374] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:17.738719 23561 raft_consensus.cc:729] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de58e9a195b4796bf9f059317bca726, State: Initialized, Role: FOLLOWER
I20260808 08:40:17.739553 23561 consensus_queue.cc:260] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:17.741545 23561 ts_tablet_manager.cc:1428] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260808 08:40:17.741945 23564 tablet_bootstrap.cc:492] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: No bootstrap required, opened a new log
I20260808 08:40:17.742281 23564 ts_tablet_manager.cc:1397] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 08:40:17.747715 23562 raft_consensus.cc:348] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:17.748248 23562 raft_consensus.cc:374] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:17.748381 23562 raft_consensus.cc:729] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Initialized, Role: FOLLOWER
I20260808 08:40:17.748993 23562 consensus_queue.cc:260] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:17.750268 23534 heartbeater.cc:503] Master 127.19.242.254:45969 was elected leader, sending a full tablet report...
I20260808 08:40:17.751029 23562 ts_tablet_manager.cc:1428] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Time spent starting tablet: real 0.013s user 0.005s sys 0.010s
I20260808 08:40:17.751648 23564 raft_consensus.cc:348] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:17.752173 23564 raft_consensus.cc:374] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:17.752311 23564 raft_consensus.cc:729] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96495451785940faae778d1e15166296, State: Initialized, Role: FOLLOWER
I20260808 08:40:17.752975 23564 consensus_queue.cc:260] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:17.754130 23338 heartbeater.cc:503] Master 127.19.242.254:45969 was elected leader, sending a full tablet report...
I20260808 08:40:17.755026 23564 ts_tablet_manager.cc:1428] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
W20260808 08:40:17.792083 23150 tablet.cc:2369] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:40:17.829998 23535 tablet.cc:2369] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:40:17.987042 23339 tablet.cc:2369] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:40:18.024057 23568 raft_consensus.cc:482] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:18.024416 23568 raft_consensus.cc:504] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:18.026237 23568 leader_election.cc:288] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96495451785940faae778d1e15166296 (127.19.242.194:39463), 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853)
I20260808 08:40:18.034116 23375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.026640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:39463 (local address 127.19.242.195:40933)
0808 08:40:18.026872 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.026894 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.027045 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.027597 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.027601 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.027636 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:18.027920 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.027943 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.029522 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.029528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.031355 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.031369 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.033151 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.033156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.033377 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.033417 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.033567 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.033729 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260808 08:40:18.034221 23558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.026700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:40933 (local address 127.19.242.194:39463)
0808 08:40:18.026975 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.026981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.027028 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:40:18.027290 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.027294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.027364 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.027530 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:18.028128 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.029361 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.031528 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.032955 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.033182 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.033248 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.033643 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.033766 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:40:18.035629 23571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.027122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:41853 (local address 127.19.242.195:58727)
0808 08:40:18.027958 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.027982 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.028126 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.028559 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.028565 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.028595 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:18.029032 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.029044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.030530 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.030535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.032952 (+ 2417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.032967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.034978 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.034983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.035108 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.035133 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.035273 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.035379 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":422,"threads_started":1}
I20260808 08:40:18.035753 23560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.027883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58727 (local address 127.19.242.193:41853)
0808 08:40:18.028114 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.028119 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.028136 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:40:18.028297 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.028301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.028396 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.028491 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:18.029223 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.030349 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.033141 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.034453 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.034618 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.034740 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.035326 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.035476 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:40:18.035756 23278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b97ffab72f4d6e961b3cafc877f915" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296" is_pre_election: true
I20260808 08:40:18.036382 23278 raft_consensus.cc:2454] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 0.
I20260808 08:40:18.036937 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b97ffab72f4d6e961b3cafc877f915" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726" is_pre_election: true
I20260808 08:40:18.037139 23368 leader_election.cc:302] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 96495451785940faae778d1e15166296; no voters:
I20260808 08:40:18.037536 23084 raft_consensus.cc:2454] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 0.
I20260808 08:40:18.037617 23568 raft_consensus.cc:2781] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:18.037786 23568 raft_consensus.cc:482] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:18.037887 23568 raft_consensus.cc:3037] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.040491 23568 raft_consensus.cc:504] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:18.041196 23568 leader_election.cc:288] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 election: Requested vote from peers 96495451785940faae778d1e15166296 (127.19.242.194:39463), 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853)
I20260808 08:40:18.041746 23278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b97ffab72f4d6e961b3cafc877f915" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296"
I20260808 08:40:18.041839 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55b97ffab72f4d6e961b3cafc877f915" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726"
I20260808 08:40:18.041958 23278 raft_consensus.cc:3037] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.042121 23084 raft_consensus.cc:3037] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.044785 23084 raft_consensus.cc:2454] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 1.
I20260808 08:40:18.044818 23278 raft_consensus.cc:2454] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 1.
I20260808 08:40:18.045363 23368 leader_election.cc:302] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 96495451785940faae778d1e15166296; no voters:
I20260808 08:40:18.045746 23568 raft_consensus.cc:2781] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:18.046347 23568 raft_consensus.cc:686] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 1 LEADER]: Becoming Leader. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Running, Role: LEADER
I20260808 08:40:18.046948 23568 consensus_queue.cc:237] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } }
I20260808 08:40:18.052565 22868 catalog_manager.cc:5495] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37be5733720340cb87e675d9bc94ac49 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:40:18 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178415, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:18.180648 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.165506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:45969 (local address 127.0.0.1:36068)
0808 08:40:18.166508 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.166537 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.166808 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.167172 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.167177 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.168035 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:18.168294 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.168305 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.169448 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.169455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.170453 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.170467 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.171325 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.171331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.171509 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.172323 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:18.172342 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:18.174853 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:18.178151 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:18.178169 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:18.178177 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:18.178688 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:18.179086 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:18.179091 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:18.179094 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:18.179245 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:18.179771 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:18.179778 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:18.179964 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.180119 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.180348 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":505,"threads_started":1}
I20260808 08:40:18.180835 23582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.165506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36068 (local address 127.19.242.254:45969)
0808 08:40:18.166497 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.166504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.166661 (+ 157us) server_negotiation.cc:407] Connection header received
0808 08:40:18.166939 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.166950 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.167016 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.167138 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:18.168470 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.169302 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.170605 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.171109 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.171269 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.175115 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:18.175121 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:18.175124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:18.175212 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:18.177972 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:18.178848 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:18.178852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:18.178855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:18.178979 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:18.179352 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:18.179356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:18.179358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:18.179643 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:18.179757 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.180272 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.180462 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":855,"thread_start_us":505,"threads_started":1}
I20260808 08:40:18.186975 22868 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:36068:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:40:18.188210 22868 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:18.196283 23243 tablet_service.cc:1467] Processing CreateTablet for tablet dcff575662944f63b93ef8240bab0dbc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=27cb864c4e154a2c90e1ebafcf83b953]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:40:18.196076 23055 tablet_service.cc:1467] Processing CreateTablet for tablet dcff575662944f63b93ef8240bab0dbc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=27cb864c4e154a2c90e1ebafcf83b953]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:40:18.196705 23437 tablet_service.cc:1467] Processing CreateTablet for tablet dcff575662944f63b93ef8240bab0dbc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=27cb864c4e154a2c90e1ebafcf83b953]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:40:18.197283 23055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcff575662944f63b93ef8240bab0dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:18.197302 23243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcff575662944f63b93ef8240bab0dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:18.197507 23437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcff575662944f63b93ef8240bab0dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:18.203996 23564 tablet_bootstrap.cc:492] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: Bootstrap starting.
I20260808 08:40:18.205191 23562 tablet_bootstrap.cc:492] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: Bootstrap starting.
I20260808 08:40:18.205585 23561 tablet_bootstrap.cc:492] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: Bootstrap starting.
I20260808 08:40:18.205998 23564 tablet_bootstrap.cc:654] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:18.207326 23561 tablet_bootstrap.cc:654] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:18.207489 23562 tablet_bootstrap.cc:654] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:18.209904 23561 tablet_bootstrap.cc:492] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: No bootstrap required, opened a new log
I20260808 08:40:18.210026 23564 tablet_bootstrap.cc:492] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: No bootstrap required, opened a new log
I20260808 08:40:18.210125 23561 ts_tablet_manager.cc:1397] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 08:40:18.210201 23562 tablet_bootstrap.cc:492] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: No bootstrap required, opened a new log
I20260808 08:40:18.210212 23564 ts_tablet_manager.cc:1397] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 08:40:18.210341 23562 ts_tablet_manager.cc:1397] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260808 08:40:18.211100 23564 raft_consensus.cc:348] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.211093 23561 raft_consensus.cc:348] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.211165 23562 raft_consensus.cc:348] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.211403 23564 raft_consensus.cc:374] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:18.211407 23562 raft_consensus.cc:374] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:18.211405 23561 raft_consensus.cc:374] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:18.211499 23562 raft_consensus.cc:729] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Initialized, Role: FOLLOWER
I20260808 08:40:18.211508 23564 raft_consensus.cc:729] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96495451785940faae778d1e15166296, State: Initialized, Role: FOLLOWER
I20260808 08:40:18.211526 23561 raft_consensus.cc:729] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de58e9a195b4796bf9f059317bca726, State: Initialized, Role: FOLLOWER
I20260808 08:40:18.211784 23562 consensus_queue.cc:260] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.211759 23564 consensus_queue.cc:260] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.211779 23561 consensus_queue.cc:260] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.212239 23568 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.212524 23564 ts_tablet_manager.cc:1428] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 08:40:18.212548 23568 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:18.212399 23569 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.212852 23569 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:18.212957 23567 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.213387 23567 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:18.213608 23562 ts_tablet_manager.cc:1428] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:18.214291 23561 ts_tablet_manager.cc:1428] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 08:40:18.313441 23568 raft_consensus.cc:482] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:18.313678 23568 raft_consensus.cc:504] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.314302 23568 leader_election.cc:288] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853), 96495451785940faae778d1e15166296 (127.19.242.194:39463)
I20260808 08:40:18.315229 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcff575662944f63b93ef8240bab0dbc" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726" is_pre_election: true
I20260808 08:40:18.315290 23278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcff575662944f63b93ef8240bab0dbc" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296" is_pre_election: true
I20260808 08:40:18.315582 23278 raft_consensus.cc:2454] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 0.
I20260808 08:40:18.315611 23084 raft_consensus.cc:2454] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 0.
I20260808 08:40:18.316112 23368 leader_election.cc:302] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 4de58e9a195b4796bf9f059317bca726; no voters:
I20260808 08:40:18.316488 23568 raft_consensus.cc:2781] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:18.316619 23568 raft_consensus.cc:482] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:18.316771 23568 raft_consensus.cc:3037] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.319240 23568 raft_consensus.cc:504] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.319897 23568 leader_election.cc:288] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 election: Requested vote from peers 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853), 96495451785940faae778d1e15166296 (127.19.242.194:39463)
I20260808 08:40:18.320714 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcff575662944f63b93ef8240bab0dbc" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726"
I20260808 08:40:18.320713 23278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcff575662944f63b93ef8240bab0dbc" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296"
I20260808 08:40:18.321012 23084 raft_consensus.cc:3037] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.321012 23278 raft_consensus.cc:3037] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.324697 23084 raft_consensus.cc:2454] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 1.
I20260808 08:40:18.324684 23278 raft_consensus.cc:2454] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 1.
I20260808 08:40:18.325345 23368 leader_election.cc:302] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 96495451785940faae778d1e15166296; no voters:
I20260808 08:40:18.325701 23568 raft_consensus.cc:2781] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:18.325956 23568 raft_consensus.cc:686] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [term 1 LEADER]: Becoming Leader. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Running, Role: LEADER
I20260808 08:40:18.326349 23568 consensus_queue.cc:237] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.328605 23573 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: TxnStatusTablet state changed. Reason: New leader 37be5733720340cb87e675d9bc94ac49. Latest consensus state: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.328938 23573 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:40:18.329746 23591 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:40:18.330118 23591 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:40:18.330324 22868 catalog_manager.cc:5495] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37be5733720340cb87e675d9bc94ac49 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } health_report { overall_health: HEALTHY } } }
I20260808 08:40:18.378647 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.370523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38099 (local address 127.0.0.1:55396)
0808 08:40:18.370849 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.370876 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.371062 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.372302 (+ 1240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.372306 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.372319 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:18.372482 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.372490 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.374145 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.374150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.375442 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.375460 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.376557 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.376563 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.376747 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.376825 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.378110 (+ 1285us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.378141 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.378231 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.378374 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:40:18.378852 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.370762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55396 (local address 127.19.242.195:38099)
0808 08:40:18.371634 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.371640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.371669 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:40:18.371770 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.371775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.371883 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.372098 (+ 215us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:18.372671 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.373945 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.375624 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.376366 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.376505 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.377097 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.377972 (+ 875us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.378134 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.378305 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.378413 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":529,"threads_started":1}
I20260808 08:40:18.388669 23084 raft_consensus.cc:1261] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Refusing update from remote peer 37be5733720340cb87e675d9bc94ac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:18.389868 23278 raft_consensus.cc:1261] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Refusing update from remote peer 37be5733720340cb87e675d9bc94ac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:18.390024 23568 consensus_queue.cc:1035] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:18.390954 23573 consensus_queue.cc:1035] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:18.401178 23569 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: TxnStatusTablet state changed. Reason: New leader 37be5733720340cb87e675d9bc94ac49. Latest consensus state: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.401582 23569 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:18.405675 23597 mvcc.cc:205] Tried to move back new op lower bound from 7316186801706455040 to 7316186801468620800. Current Snapshot: MvccSnapshot[applied={T|T < 7316186801706455040}]
I20260808 08:40:18.411322 23568 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.411671 23568 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:40:18.415253 23569 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.415552 23569 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 96495451785940faae778d1e15166296: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:18.418989 23567 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: TxnStatusTablet state changed. Reason: New leader 37be5733720340cb87e675d9bc94ac49. Latest consensus state: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.419296 23567 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:18.426471 23567 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.426783 23567 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 4de58e9a195b4796bf9f059317bca726: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:40:18.425526 23610 tablet_replica.cc:439] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } } }
I20260808 08:40:18.428372 23610 tablet_replica.cc:442] T dcff575662944f63b93ef8240bab0dbc P 37be5733720340cb87e675d9bc94ac49: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:40:18.438555 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.432093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55400 (local address 127.19.242.195:38099)
0808 08:40:18.432350 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.432359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.432871 (+ 512us) server_negotiation.cc:407] Connection header received
0808 08:40:18.433098 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.433103 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.433179 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.433300 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:18.433854 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.434945 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.436556 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.437040 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.437198 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.437684 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.437803 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.437931 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.438097 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.438189 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:40:18.459980 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.452686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:57275 (local address 127.19.242.195:38099)
0808 08:40:18.452910 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.452919 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.453737 (+ 818us) server_negotiation.cc:407] Connection header received
0808 08:40:18.454000 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.454007 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.454079 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.454188 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:18.454919 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.455728 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.457965 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.458415 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.458521 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.459211 (+ 690us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.459324 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.459409 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.459599 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.459671 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:40:18.460247 23618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.452784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38099 (local address 127.19.242.195:57275)
0808 08:40:18.453620 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.453636 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.453842 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.454242 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.454252 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.454267 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:18.454689 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.454729 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.455874 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.455880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.457788 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.457804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.458630 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.458636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.458858 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.458954 (+ 96us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.459440 (+ 486us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.459460 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.459555 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.459716 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":475,"threads_started":1}
I20260808 08:40:18.471589 23084 raft_consensus.cc:1261] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Refusing update from remote peer 37be5733720340cb87e675d9bc94ac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:18.471786 23278 raft_consensus.cc:1261] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Refusing update from remote peer 37be5733720340cb87e675d9bc94ac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:18.472581 23573 consensus_queue.cc:1035] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:18.472924 23610 consensus_queue.cc:1035] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:18.483857 23601 mvcc.cc:205] Tried to move back new op lower bound from 7316186802053591040 to 7316186800324640768. Current Snapshot: MvccSnapshot[applied={T|T < 7316186802053591040}]
I20260808 08:40:18.541211 22868 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:18.541468 22868 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:18.545624 22868 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Sending DeleteTablet for 3 replicas of tablet 55b97ffab72f4d6e961b3cafc877f915
I20260808 08:40:18.547101 23433 tablet_service.cc:1514] Processing DeleteTablet for tablet 55b97ffab72f4d6e961b3cafc877f915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:18 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:55386
I20260808 08:40:18.547374 23055 tablet_service.cc:1514] Processing DeleteTablet for tablet 55b97ffab72f4d6e961b3cafc877f915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:18 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:49792
I20260808 08:40:18.548514 23243 tablet_service.cc:1514] Processing DeleteTablet for tablet 55b97ffab72f4d6e961b3cafc877f915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:18 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:40114
I20260808 08:40:18.549008 22868 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:18.550078 22868 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:18.559258 23630 tablet_replica.cc:330] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: stopping tablet replica
I20260808 08:40:18.559737 23055 tablet_service.cc:1467] Processing CreateTablet for tablet cb4e259104e64561b08e38002b0d6d87 (DEFAULT_TABLE table=test-table [id=9a77dc28508546058e248d6238005e8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:18.560125 23437 tablet_service.cc:1467] Processing CreateTablet for tablet cb4e259104e64561b08e38002b0d6d87 (DEFAULT_TABLE table=test-table [id=9a77dc28508546058e248d6238005e8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:18.560334 23055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb4e259104e64561b08e38002b0d6d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:18.560626 23437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb4e259104e64561b08e38002b0d6d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:18.561892 23630 raft_consensus.cc:2229] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:18.562390 23630 raft_consensus.cc:2258] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:18.563350 23624 tablet_replica.cc:330] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: stopping tablet replica
I20260808 08:40:18.564878 23630 ts_tablet_manager.cc:1905] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:18.565248 23624 raft_consensus.cc:2229] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:18.566041 23624 raft_consensus.cc:2258] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:18.567039 23243 tablet_service.cc:1467] Processing CreateTablet for tablet cb4e259104e64561b08e38002b0d6d87 (DEFAULT_TABLE table=test-table [id=9a77dc28508546058e248d6238005e8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:18.567569 23243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb4e259104e64561b08e38002b0d6d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:18.570201 23562 tablet_bootstrap.cc:492] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: Bootstrap starting.
I20260808 08:40:18.572760 23562 tablet_bootstrap.cc:654] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:18.575099 23627 tablet_replica.cc:330] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: stopping tablet replica
I20260808 08:40:18.575657 23627 raft_consensus.cc:2229] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:18.576089 23627 raft_consensus.cc:2258] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:18.576869 23564 tablet_bootstrap.cc:492] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: Bootstrap starting.
I20260808 08:40:18.577787 23624 ts_tablet_manager.cc:1905] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:18.578930 23564 tablet_bootstrap.cc:654] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:18.589860 23627 ts_tablet_manager.cc:1905] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:18.600607 23562 tablet_bootstrap.cc:492] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: No bootstrap required, opened a new log
I20260808 08:40:18.600910 23562 ts_tablet_manager.cc:1397] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.003s
I20260808 08:40:18.602389 23562 raft_consensus.cc:348] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.603516 23562 raft_consensus.cc:374] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:18.603672 23562 raft_consensus.cc:729] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Initialized, Role: FOLLOWER
I20260808 08:40:18.604144 23562 consensus_queue.cc:260] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.605094 23562 ts_tablet_manager.cc:1428] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 08:40:18.617725 23630 ts_tablet_manager.cc:1918] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:18.618027 23630 log.cc:1196] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/55b97ffab72f4d6e961b3cafc877f915
I20260808 08:40:18.620365 23624 ts_tablet_manager.cc:1918] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:18.620738 23624 log.cc:1196] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/55b97ffab72f4d6e961b3cafc877f915
I20260808 08:40:18.621148 23561 tablet_bootstrap.cc:492] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: Bootstrap starting.
I20260808 08:40:18.621479 23624 ts_tablet_manager.cc:1939] T 55b97ffab72f4d6e961b3cafc877f915 P 37be5733720340cb87e675d9bc94ac49: Deleting consensus metadata
I20260808 08:40:18.624722 23561 tablet_bootstrap.cc:654] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:18.626317 22855 catalog_manager.cc:4841] TS 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099): tablet 55b97ffab72f4d6e961b3cafc877f915 (table test-table [id=94e92110b763428d814b2d91e2917275]) successfully deleted
I20260808 08:40:18.636889 23564 tablet_bootstrap.cc:492] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: No bootstrap required, opened a new log
I20260808 08:40:18.637135 23564 ts_tablet_manager.cc:1397] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.042s
I20260808 08:40:18.637444 23561 tablet_bootstrap.cc:492] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: No bootstrap required, opened a new log
I20260808 08:40:18.637630 23561 ts_tablet_manager.cc:1397] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.003s
I20260808 08:40:18.638077 23564 raft_consensus.cc:348] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.638371 23564 raft_consensus.cc:374] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:18.638468 23564 raft_consensus.cc:729] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96495451785940faae778d1e15166296, State: Initialized, Role: FOLLOWER
I20260808 08:40:18.638368 23561 raft_consensus.cc:348] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.638635 23561 raft_consensus.cc:374] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:18.638751 23561 raft_consensus.cc:729] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de58e9a195b4796bf9f059317bca726, State: Initialized, Role: FOLLOWER
I20260808 08:40:18.638877 23564 consensus_queue.cc:260] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.639106 23561 consensus_queue.cc:260] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.642469 23561 ts_tablet_manager.cc:1428] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260808 08:40:18.642591 23564 ts_tablet_manager.cc:1428] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:40:18.646576 23627 ts_tablet_manager.cc:1918] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:18.646840 23627 log.cc:1196] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/55b97ffab72f4d6e961b3cafc877f915
I20260808 08:40:18.647503 23627 ts_tablet_manager.cc:1939] T 55b97ffab72f4d6e961b3cafc877f915 P 4de58e9a195b4796bf9f059317bca726: Deleting consensus metadata
I20260808 08:40:18.650509 22855 catalog_manager.cc:4841] TS 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853): tablet 55b97ffab72f4d6e961b3cafc877f915 (table test-table [id=94e92110b763428d814b2d91e2917275]) successfully deleted
I20260808 08:40:18.654794 23630 ts_tablet_manager.cc:1939] T 55b97ffab72f4d6e961b3cafc877f915 P 96495451785940faae778d1e15166296: Deleting consensus metadata
I20260808 08:40:18.657076 22855 catalog_manager.cc:4841] TS 96495451785940faae778d1e15166296 (127.19.242.194:39463): tablet 55b97ffab72f4d6e961b3cafc877f915 (table test-table [id=94e92110b763428d814b2d91e2917275]) successfully deleted
I20260808 08:40:18.706316 23567 raft_consensus.cc:482] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:18.706561 23567 raft_consensus.cc:504] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.708554 23567 leader_election.cc:288] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96495451785940faae778d1e15166296 (127.19.242.194:39463), 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099)
I20260808 08:40:18.718540 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.710080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:60757 (local address 127.19.242.195:38099)
0808 08:40:18.710300 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.710308 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.710643 (+ 335us) server_negotiation.cc:407] Connection header received
0808 08:40:18.711011 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.711017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.711118 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.711259 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:18.712044 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.712862 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.716351 (+ 3489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.717421 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.717641 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.717749 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.718056 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.718212 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:40:18.718655 23640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.709907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38099 (local address 127.19.242.193:60757)
0808 08:40:18.710519 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.710542 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.710813 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.711373 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.711377 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.711401 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:18.711844 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.711854 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.713032 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.713040 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.716063 (+ 3023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.716084 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.717637 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.717645 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.717856 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.717885 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.718006 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.718190 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":166,"thread_start_us":257,"threads_started":1}
I20260808 08:40:18.719142 23637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.708761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:39463 (local address 127.19.242.193:46889)
0808 08:40:18.709744 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.709777 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.709932 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.711183 (+ 1251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.711188 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.711215 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:18.711549 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.711568 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.713235 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.713241 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.716063 (+ 2822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.716084 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.718170 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.718178 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.718385 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.718422 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.718532 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.718686 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"mutex_wait_us":142,"thread_start_us":634,"threads_started":1}
I20260808 08:40:18.719704 23639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.708917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:46889 (local address 127.19.242.194:39463)
0808 08:40:18.710824 (+ 1907us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.710830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.710858 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:40:18.710945 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.710951 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.711030 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.711148 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:18.711746 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.712952 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.716292 (+ 3340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.717642 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.717857 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.717940 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.719148 (+ 1208us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.719335 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1724,"thread_start_us":1600,"threads_started":1}
I20260808 08:40:18.720022 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4e259104e64561b08e38002b0d6d87" candidate_uuid: "4de58e9a195b4796bf9f059317bca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37be5733720340cb87e675d9bc94ac49" is_pre_election: true
I20260808 08:40:18.720458 23278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4e259104e64561b08e38002b0d6d87" candidate_uuid: "4de58e9a195b4796bf9f059317bca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296" is_pre_election: true
I20260808 08:40:18.720613 23473 raft_consensus.cc:2454] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de58e9a195b4796bf9f059317bca726 in term 0.
I20260808 08:40:18.720726 23278 raft_consensus.cc:2454] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de58e9a195b4796bf9f059317bca726 in term 0.
I20260808 08:40:18.721361 22992 leader_election.cc:302] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 4de58e9a195b4796bf9f059317bca726; no voters:
I20260808 08:40:18.721874 23567 raft_consensus.cc:2781] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:18.722050 23567 raft_consensus.cc:482] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:18.722250 23567 raft_consensus.cc:3037] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.725431 23567 raft_consensus.cc:504] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.726255 23567 leader_election.cc:288] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [CANDIDATE]: Term 1 election: Requested vote from peers 96495451785940faae778d1e15166296 (127.19.242.194:39463), 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099)
I20260808 08:40:18.727075 23473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4e259104e64561b08e38002b0d6d87" candidate_uuid: "4de58e9a195b4796bf9f059317bca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37be5733720340cb87e675d9bc94ac49"
I20260808 08:40:18.727201 23278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb4e259104e64561b08e38002b0d6d87" candidate_uuid: "4de58e9a195b4796bf9f059317bca726" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296"
I20260808 08:40:18.727433 23473 raft_consensus.cc:3037] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.727473 23278 raft_consensus.cc:3037] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:18.730299 23473 raft_consensus.cc:2454] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de58e9a195b4796bf9f059317bca726 in term 1.
I20260808 08:40:18.730866 23278 raft_consensus.cc:2454] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de58e9a195b4796bf9f059317bca726 in term 1.
I20260808 08:40:18.731071 22992 leader_election.cc:302] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 4de58e9a195b4796bf9f059317bca726; no voters:
I20260808 08:40:18.731530 23567 raft_consensus.cc:2781] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:18.732124 23567 raft_consensus.cc:686] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 1 LEADER]: Becoming Leader. State: Replica: 4de58e9a195b4796bf9f059317bca726, State: Running, Role: LEADER
I20260808 08:40:18.732678 23567 consensus_queue.cc:237] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:18.737793 22868 catalog_manager.cc:5495] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de58e9a195b4796bf9f059317bca726 (127.19.242.193). New cstate: current_term: 1 leader_uuid: "4de58e9a195b4796bf9f059317bca726" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } health_report { overall_health: UNKNOWN } } }
I20260808 08:40:18.785558 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.778067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.19.242.193:41853)
0808 08:40:18.778847 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.778852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.778873 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:40:18.778968 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.778971 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.779055 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.779210 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:18.779743 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.780569 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.782595 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.783227 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.783416 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.783965 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.784634 (+ 669us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.784806 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.785012 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.785139 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":473,"threads_started":1}
I20260808 08:40:18.804500 23647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.797713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38099 (local address 127.19.242.193:39837)
0808 08:40:18.798518 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.798536 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.798681 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.799149 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.799152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.799162 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:18.799445 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.799454 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.801031 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.801036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.802162 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.802177 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.803328 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.803333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.803467 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.803535 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.803989 (+ 454us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.803998 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.804062 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.804199 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":401,"threads_started":1}
I20260808 08:40:18.804508 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.797715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:39837 (local address 127.19.242.195:38099)
0808 08:40:18.797958 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.797965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.798641 (+ 676us) server_negotiation.cc:407] Connection header received
0808 08:40:18.798891 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.798898 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.799008 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.799137 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:18.799597 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.800841 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.802330 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.803126 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.803259 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.803727 (+ 468us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.803885 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.803977 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.804120 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.804214 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:40:18.814483 23278 raft_consensus.cc:1261] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Refusing update from remote peer 4de58e9a195b4796bf9f059317bca726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:18.814625 23473 raft_consensus.cc:1261] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Refusing update from remote peer 4de58e9a195b4796bf9f059317bca726: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:18.815349 23641 consensus_queue.cc:1035] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:18.815855 23567 consensus_queue.cc:1035] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:18.858314 23644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.851901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58509 (local address 127.19.242.193:41853)
0808 08:40:18.852157 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:18.852165 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:18.852187 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:40:18.852316 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:18.852323 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:18.852444 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:18.853042 (+ 598us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:18.853221 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.854384 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.856370 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.856955 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.857104 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.857484 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.857628 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.857712 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:18.857914 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 08:40:18.858000 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:40:18.858420 23618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:18.850900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:41853 (local address 127.19.242.195:58509)
0808 08:40:18.851465 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:18.851482 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:18.851582 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:18.852635 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:18.852640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:18.852653 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:18.852884 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.852898 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.854602 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.854609 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.856206 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:18.856221 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:18.857116 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:18.857122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:18.857269 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:18.857311 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:18.857773 (+ 462us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:18.857783 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:40:18.857889 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:40:18.858043 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425}
W20260808 08:40:18.860037 23601 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:40:20.501575 22867 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:20.501816 22867 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:20.507702 22867 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Sending DeleteTablet for 3 replicas of tablet cb4e259104e64561b08e38002b0d6d87
I20260808 08:40:20.508901 23055 tablet_service.cc:1514] Processing DeleteTablet for tablet cb4e259104e64561b08e38002b0d6d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:20 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:49792
I20260808 08:40:20.508970 23243 tablet_service.cc:1514] Processing DeleteTablet for tablet cb4e259104e64561b08e38002b0d6d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:20 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:40114
I20260808 08:40:20.509416 23433 tablet_service.cc:1514] Processing DeleteTablet for tablet cb4e259104e64561b08e38002b0d6d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:20 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:55386
I20260808 08:40:20.509743 23687 tablet_replica.cc:330] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: stopping tablet replica
I20260808 08:40:20.510006 23687 raft_consensus.cc:2229] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:20.510773 23688 tablet_replica.cc:330] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: stopping tablet replica
I20260808 08:40:20.510782 23687 raft_consensus.cc:2258] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:20.511513 23688 raft_consensus.cc:2229] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:20.511881 23688 raft_consensus.cc:2258] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:20.512277 23687 ts_tablet_manager.cc:1905] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:20.513080 23688 ts_tablet_manager.cc:1905] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:20.520668 23688 ts_tablet_manager.cc:1918] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:40:20.520936 23688 log.cc:1196] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/cb4e259104e64561b08e38002b0d6d87
I20260808 08:40:20.521155 23687 ts_tablet_manager.cc:1918] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:40:20.521341 23687 log.cc:1196] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/cb4e259104e64561b08e38002b0d6d87
I20260808 08:40:20.521467 23688 ts_tablet_manager.cc:1939] T cb4e259104e64561b08e38002b0d6d87 P 96495451785940faae778d1e15166296: Deleting consensus metadata
I20260808 08:40:20.521924 23687 ts_tablet_manager.cc:1939] T cb4e259104e64561b08e38002b0d6d87 P 4de58e9a195b4796bf9f059317bca726: Deleting consensus metadata
I20260808 08:40:20.522989 22855 catalog_manager.cc:4841] TS 96495451785940faae778d1e15166296 (127.19.242.194:39463): tablet cb4e259104e64561b08e38002b0d6d87 (table test-table [id=9a77dc28508546058e248d6238005e8f]) successfully deleted
I20260808 08:40:20.524478 23689 tablet_replica.cc:330] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: stopping tablet replica
I20260808 08:40:20.524731 23689 raft_consensus.cc:2229] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:20.525043 23689 raft_consensus.cc:2258] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:20.526310 22855 catalog_manager.cc:4841] TS 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853): tablet cb4e259104e64561b08e38002b0d6d87 (table test-table [id=9a77dc28508546058e248d6238005e8f]) successfully deleted
I20260808 08:40:20.526477 23689 ts_tablet_manager.cc:1905] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:20.535007 23689 ts_tablet_manager.cc:1918] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:40:20.535246 23689 log.cc:1196] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/cb4e259104e64561b08e38002b0d6d87
I20260808 08:40:20.535867 23689 ts_tablet_manager.cc:1939] T cb4e259104e64561b08e38002b0d6d87 P 37be5733720340cb87e675d9bc94ac49: Deleting consensus metadata
I20260808 08:40:20.537489 22855 catalog_manager.cc:4841] TS 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099): tablet cb4e259104e64561b08e38002b0d6d87 (table test-table [id=9a77dc28508546058e248d6238005e8f]) successfully deleted
Aug 08 08:40:20 dist-test-slave-39l8 krb5kdc[22816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:40:20 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:20.590932 23699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:20.567497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36078 (local address 127.19.242.254:45969)
0808 08:40:20.568237 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:20.568243 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:20.568317 (+ 74us) server_negotiation.cc:407] Connection header received
0808 08:40:20.568520 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:20.568524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:20.568594 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:20.568721 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:20.570290 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:20.571221 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:20.572578 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:20.573024 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:20.573145 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:20.582555 (+ 9410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:20.582564 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:20.582579 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:20.582638 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:20.587348 (+ 4710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:20.588414 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:20.588421 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:20.588425 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:20.588625 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:20.589099 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:20.589106 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:20.589110 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:20.589526 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:20.589823 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:20.590181 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:40:20.590442 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":407,"threads_started":1}
I20260808 08:40:20.595732 22867 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:20.596484 22867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:20.604823 23055 tablet_service.cc:1467] Processing CreateTablet for tablet 1902ac97b2824c2aa0aa155d33600f72 (DEFAULT_TABLE table=test-table [id=c00a98507c9746ae8a4c4617e40bcb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:20.604836 23243 tablet_service.cc:1467] Processing CreateTablet for tablet 1902ac97b2824c2aa0aa155d33600f72 (DEFAULT_TABLE table=test-table [id=c00a98507c9746ae8a4c4617e40bcb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:20.605340 23055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1902ac97b2824c2aa0aa155d33600f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:20.605348 23243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1902ac97b2824c2aa0aa155d33600f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:20.606951 23433 tablet_service.cc:1467] Processing CreateTablet for tablet 1902ac97b2824c2aa0aa155d33600f72 (DEFAULT_TABLE table=test-table [id=c00a98507c9746ae8a4c4617e40bcb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:20.607486 23433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1902ac97b2824c2aa0aa155d33600f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:20.614055 23702 tablet_bootstrap.cc:492] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: Bootstrap starting.
I20260808 08:40:20.614825 23703 tablet_bootstrap.cc:492] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: Bootstrap starting.
I20260808 08:40:20.614866 23701 tablet_bootstrap.cc:492] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: Bootstrap starting.
I20260808 08:40:20.616766 23703 tablet_bootstrap.cc:654] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:20.617718 23701 tablet_bootstrap.cc:654] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:20.620595 23703 tablet_bootstrap.cc:492] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: No bootstrap required, opened a new log
I20260808 08:40:20.621110 23701 tablet_bootstrap.cc:492] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: No bootstrap required, opened a new log
I20260808 08:40:20.621184 23703 ts_tablet_manager.cc:1397] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 08:40:20.621376 23701 ts_tablet_manager.cc:1397] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260808 08:40:20.621774 23702 tablet_bootstrap.cc:654] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:20.622977 23701 raft_consensus.cc:348] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.622936 23703 raft_consensus.cc:348] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.623245 23701 raft_consensus.cc:374] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:20.623314 23703 raft_consensus.cc:374] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:20.623467 23701 raft_consensus.cc:729] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de58e9a195b4796bf9f059317bca726, State: Initialized, Role: FOLLOWER
I20260808 08:40:20.623504 23703 raft_consensus.cc:729] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Initialized, Role: FOLLOWER
I20260808 08:40:20.624013 23703 consensus_queue.cc:260] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.623886 23701 consensus_queue.cc:260] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.624684 23703 ts_tablet_manager.cc:1428] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 08:40:20.625624 23701 ts_tablet_manager.cc:1428] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:20.626123 23702 tablet_bootstrap.cc:492] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: No bootstrap required, opened a new log
I20260808 08:40:20.626363 23702 ts_tablet_manager.cc:1397] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.007s
I20260808 08:40:20.627939 23702 raft_consensus.cc:348] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.628254 23702 raft_consensus.cc:374] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:20.628373 23702 raft_consensus.cc:729] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96495451785940faae778d1e15166296, State: Initialized, Role: FOLLOWER
I20260808 08:40:20.628679 23702 consensus_queue.cc:260] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.629908 23702 ts_tablet_manager.cc:1428] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 08:40:20.874122 23654 raft_consensus.cc:482] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:20.874444 23654 raft_consensus.cc:504] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.875221 23654 leader_election.cc:288] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853), 96495451785940faae778d1e15166296 (127.19.242.194:39463)
I20260808 08:40:20.876125 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1902ac97b2824c2aa0aa155d33600f72" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726" is_pre_election: true
I20260808 08:40:20.876138 23277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1902ac97b2824c2aa0aa155d33600f72" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296" is_pre_election: true
I20260808 08:40:20.876425 23277 raft_consensus.cc:2454] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 0.
I20260808 08:40:20.876503 23084 raft_consensus.cc:2454] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 0.
I20260808 08:40:20.877140 23368 leader_election.cc:302] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 4de58e9a195b4796bf9f059317bca726; no voters:
I20260808 08:40:20.877568 23654 raft_consensus.cc:2781] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:20.877756 23654 raft_consensus.cc:482] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:20.877931 23654 raft_consensus.cc:3037] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:20.880903 23654 raft_consensus.cc:504] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.881637 23654 leader_election.cc:288] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 election: Requested vote from peers 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853), 96495451785940faae778d1e15166296 (127.19.242.194:39463)
I20260808 08:40:20.882443 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1902ac97b2824c2aa0aa155d33600f72" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726"
I20260808 08:40:20.882840 23084 raft_consensus.cc:3037] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:20.882885 23277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1902ac97b2824c2aa0aa155d33600f72" candidate_uuid: "37be5733720340cb87e675d9bc94ac49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96495451785940faae778d1e15166296"
I20260808 08:40:20.883230 23277 raft_consensus.cc:3037] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:20.885748 23277 raft_consensus.cc:2454] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 1.
I20260808 08:40:20.885842 23084 raft_consensus.cc:2454] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37be5733720340cb87e675d9bc94ac49 in term 1.
I20260808 08:40:20.886358 23368 leader_election.cc:302] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 96495451785940faae778d1e15166296; no voters:
I20260808 08:40:20.886795 23654 raft_consensus.cc:2781] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:20.886973 23654 raft_consensus.cc:686] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 1 LEADER]: Becoming Leader. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Running, Role: LEADER
I20260808 08:40:20.887355 23654 consensus_queue.cc:237] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:20.890681 22868 catalog_manager.cc:5495] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37be5733720340cb87e675d9bc94ac49 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "37be5733720340cb87e675d9bc94ac49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } health_report { overall_health: HEALTHY } } }
I20260808 08:40:20.933079 23711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:20.926638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.19.242.195:38099)
0808 08:40:20.927544 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:20.927549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:20.927576 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:40:20.927645 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:20.927649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:20.927720 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:20.927813 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:20.928286 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:20.929423 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:20.930865 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:20.931566 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:20.931732 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:20.932279 (+ 547us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:20.932409 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:20.932520 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:20.932659 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 08:40:20.932743 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":479,"threads_started":1}
I20260808 08:40:20.944677 23084 raft_consensus.cc:1261] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Refusing update from remote peer 37be5733720340cb87e675d9bc94ac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:20.944608 23278 raft_consensus.cc:1261] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Refusing update from remote peer 37be5733720340cb87e675d9bc94ac49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:20.945333 23659 consensus_queue.cc:1035] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:20.945627 23654 consensus_queue.cc:1035] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:21.005024 22868 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:21.005329 22868 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:21.008754 22868 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Sending DeleteTablet for 3 replicas of tablet 1902ac97b2824c2aa0aa155d33600f72
I20260808 08:40:21.009907 23243 tablet_service.cc:1514] Processing DeleteTablet for tablet 1902ac97b2824c2aa0aa155d33600f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:21 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:40114
I20260808 08:40:21.009933 23437 tablet_service.cc:1514] Processing DeleteTablet for tablet 1902ac97b2824c2aa0aa155d33600f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:21 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:55386
I20260808 08:40:21.009922 23055 tablet_service.cc:1514] Processing DeleteTablet for tablet 1902ac97b2824c2aa0aa155d33600f72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:21 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:49792
I20260808 08:40:21.010237 23688 tablet_replica.cc:330] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: stopping tablet replica
I20260808 08:40:21.010241 23687 tablet_replica.cc:330] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: stopping tablet replica
I20260808 08:40:21.010277 23689 tablet_replica.cc:330] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: stopping tablet replica
I20260808 08:40:21.010473 23688 raft_consensus.cc:2229] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:21.010478 23689 raft_consensus.cc:2229] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:21.010545 23687 raft_consensus.cc:2229] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:21.010706 23688 raft_consensus.cc:2258] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:21.010813 23687 raft_consensus.cc:2258] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:21.010888 23689 raft_consensus.cc:2258] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:21.011762 22868 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 08:40:21.012153 23687 ts_tablet_manager.cc:1905] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:21.012153 23689 ts_tablet_manager.cc:1905] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 08:40:21.012534 22868 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:21.012657 23688 ts_tablet_manager.cc:1905] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:21.020721 23055 tablet_service.cc:1467] Processing CreateTablet for tablet 677c3fe0876248e6b58a2d2eb75b64b3 (DEFAULT_TABLE table=test-table [id=8de6f40eabea4c5fa1e8dfcac8cde7ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:21.020964 23687 ts_tablet_manager.cc:1918] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:21.021232 23687 log.cc:1196] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/1902ac97b2824c2aa0aa155d33600f72
I20260808 08:40:21.021405 23055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 677c3fe0876248e6b58a2d2eb75b64b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:21.021448 23688 ts_tablet_manager.cc:1918] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:21.021763 23688 log.cc:1196] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/1902ac97b2824c2aa0aa155d33600f72
I20260808 08:40:21.022156 23687 ts_tablet_manager.cc:1939] T 1902ac97b2824c2aa0aa155d33600f72 P 4de58e9a195b4796bf9f059317bca726: Deleting consensus metadata
I20260808 08:40:21.022744 23688 ts_tablet_manager.cc:1939] T 1902ac97b2824c2aa0aa155d33600f72 P 96495451785940faae778d1e15166296: Deleting consensus metadata
I20260808 08:40:21.024423 22855 catalog_manager.cc:4841] TS 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853): tablet 1902ac97b2824c2aa0aa155d33600f72 (table test-table [id=c00a98507c9746ae8a4c4617e40bcb87]) successfully deleted
I20260808 08:40:21.024792 22855 catalog_manager.cc:4841] TS 96495451785940faae778d1e15166296 (127.19.242.194:39463): tablet 1902ac97b2824c2aa0aa155d33600f72 (table test-table [id=c00a98507c9746ae8a4c4617e40bcb87]) successfully deleted
I20260808 08:40:21.025122 23243 tablet_service.cc:1467] Processing CreateTablet for tablet 677c3fe0876248e6b58a2d2eb75b64b3 (DEFAULT_TABLE table=test-table [id=8de6f40eabea4c5fa1e8dfcac8cde7ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:21.025135 23437 tablet_service.cc:1467] Processing CreateTablet for tablet 677c3fe0876248e6b58a2d2eb75b64b3 (DEFAULT_TABLE table=test-table [id=8de6f40eabea4c5fa1e8dfcac8cde7ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:21.025826 23243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 677c3fe0876248e6b58a2d2eb75b64b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:21.025957 23437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 677c3fe0876248e6b58a2d2eb75b64b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:21.028662 23689 ts_tablet_manager.cc:1918] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:40:21.029026 23689 log.cc:1196] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/1902ac97b2824c2aa0aa155d33600f72
I20260808 08:40:21.029851 23689 ts_tablet_manager.cc:1939] T 1902ac97b2824c2aa0aa155d33600f72 P 37be5733720340cb87e675d9bc94ac49: Deleting consensus metadata
I20260808 08:40:21.031189 23701 tablet_bootstrap.cc:492] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: Bootstrap starting.
I20260808 08:40:21.031605 22855 catalog_manager.cc:4841] TS 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099): tablet 1902ac97b2824c2aa0aa155d33600f72 (table test-table [id=c00a98507c9746ae8a4c4617e40bcb87]) successfully deleted
I20260808 08:40:21.034047 23701 tablet_bootstrap.cc:654] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:21.036942 23703 tablet_bootstrap.cc:492] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: Bootstrap starting.
I20260808 08:40:21.037388 23702 tablet_bootstrap.cc:492] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: Bootstrap starting.
I20260808 08:40:21.040522 23703 tablet_bootstrap.cc:654] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:21.040875 23702 tablet_bootstrap.cc:654] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:21.043511 23701 tablet_bootstrap.cc:492] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: No bootstrap required, opened a new log
I20260808 08:40:21.043849 23701 ts_tablet_manager.cc:1397] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.009s
I20260808 08:40:21.045274 23701 raft_consensus.cc:348] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.045681 23701 raft_consensus.cc:374] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:21.045847 23702 tablet_bootstrap.cc:492] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: No bootstrap required, opened a new log
I20260808 08:40:21.045861 23701 raft_consensus.cc:729] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de58e9a195b4796bf9f059317bca726, State: Initialized, Role: FOLLOWER
I20260808 08:40:21.046195 23702 ts_tablet_manager.cc:1397] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260808 08:40:21.046344 23701 consensus_queue.cc:260] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.047809 23703 tablet_bootstrap.cc:492] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: No bootstrap required, opened a new log
I20260808 08:40:21.047915 23701 ts_tablet_manager.cc:1428] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260808 08:40:21.047706 23702 raft_consensus.cc:348] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.048211 23702 raft_consensus.cc:374] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:21.048355 23703 ts_tablet_manager.cc:1397] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260808 08:40:21.048448 23702 raft_consensus.cc:729] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96495451785940faae778d1e15166296, State: Initialized, Role: FOLLOWER
I20260808 08:40:21.048902 23702 consensus_queue.cc:260] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.049928 23702 ts_tablet_manager.cc:1428] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260808 08:40:21.050330 23703 raft_consensus.cc:348] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.050726 23703 raft_consensus.cc:374] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:21.050933 23703 raft_consensus.cc:729] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37be5733720340cb87e675d9bc94ac49, State: Initialized, Role: FOLLOWER
I20260808 08:40:21.052569 23703 consensus_queue.cc:260] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.053484 23703 ts_tablet_manager.cc:1428] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 08:40:21.267824 23708 raft_consensus.cc:482] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:21.268263 23708 raft_consensus.cc:504] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.270752 23708 leader_election.cc:288] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853), 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099)
I20260808 08:40:21.282097 23719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.271170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:45493 (local address 127.19.242.193:41853)
0808 08:40:21.272443 (+ 1273us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:21.272449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:21.272612 (+ 163us) server_negotiation.cc:407] Connection header received
0808 08:40:21.272941 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:21.272947 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:21.273101 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:21.274135 (+ 1034us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:21.274802 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.276060 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.279267 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.280519 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.280778 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.280875 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:21.281222 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 08:40:21.281409 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1119,"thread_start_us":741,"threads_started":1}
I20260808 08:40:21.282301 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.271278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:41853 (local address 127.19.242.194:45493)
0808 08:40:21.272489 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:21.272511 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:21.272713 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:21.273380 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:21.273386 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:21.273432 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:21.274520 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.274540 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.276279 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.276285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.279014 (+ 2729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.279029 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.280820 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.280829 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.281048 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.281075 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:40:21.281193 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:40:21.281369 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"mutex_wait_us":51,"thread_start_us":768,"threads_started":1}
I20260808 08:40:21.283109 23711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.273201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:48583 (local address 127.19.242.195:38099)
0808 08:40:21.273408 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:21.273415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:21.273980 (+ 565us) server_negotiation.cc:407] Connection header received
0808 08:40:21.274200 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:21.274205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:21.274266 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:21.274373 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:21.275721 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.277198 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.280381 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.281590 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.281863 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.281967 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:21.282632 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 08:40:21.282822 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:40:21.283296 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "677c3fe0876248e6b58a2d2eb75b64b3" candidate_uuid: "96495451785940faae778d1e15166296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726" is_pre_election: true
I20260808 08:40:21.283788 23724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.272631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38099 (local address 127.19.242.194:48583)
0808 08:40:21.273847 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:21.273863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:21.273996 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:21.274395 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:21.274399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:21.274424 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:21.275449 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.275466 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.277383 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.277389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.280152 (+ 2763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.280168 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.281963 (+ 1795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.281974 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.282408 (+ 434us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.282449 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:40:21.282582 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 08:40:21.282799 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1082,"mutex_wait_us":53,"thread_start_us":746,"threads_started":1}
I20260808 08:40:21.283975 23083 raft_consensus.cc:2454] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96495451785940faae778d1e15166296 in term 0.
I20260808 08:40:21.284740 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "677c3fe0876248e6b58a2d2eb75b64b3" candidate_uuid: "96495451785940faae778d1e15166296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37be5733720340cb87e675d9bc94ac49" is_pre_election: true
I20260808 08:40:21.284860 23183 leader_election.cc:302] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de58e9a195b4796bf9f059317bca726, 96495451785940faae778d1e15166296; no voters:
I20260808 08:40:21.285209 23472 raft_consensus.cc:2454] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96495451785940faae778d1e15166296 in term 0.
I20260808 08:40:21.285684 23708 raft_consensus.cc:2781] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:21.285913 23708 raft_consensus.cc:482] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:21.286180 23708 raft_consensus.cc:3037] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:21.289974 23708 raft_consensus.cc:504] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.291064 23708 leader_election.cc:288] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [CANDIDATE]: Term 1 election: Requested vote from peers 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853), 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099)
I20260808 08:40:21.292024 23472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "677c3fe0876248e6b58a2d2eb75b64b3" candidate_uuid: "96495451785940faae778d1e15166296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37be5733720340cb87e675d9bc94ac49"
I20260808 08:40:21.291982 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "677c3fe0876248e6b58a2d2eb75b64b3" candidate_uuid: "96495451785940faae778d1e15166296" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de58e9a195b4796bf9f059317bca726"
I20260808 08:40:21.292379 23472 raft_consensus.cc:3037] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:21.292377 23083 raft_consensus.cc:3037] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:21.296238 23472 raft_consensus.cc:2454] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96495451785940faae778d1e15166296 in term 1.
I20260808 08:40:21.296938 23183 leader_election.cc:302] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37be5733720340cb87e675d9bc94ac49, 96495451785940faae778d1e15166296; no voters:
I20260808 08:40:21.297562 23708 raft_consensus.cc:2781] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:21.297564 23083 raft_consensus.cc:2454] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96495451785940faae778d1e15166296 in term 1.
I20260808 08:40:21.299039 23708 raft_consensus.cc:686] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 1 LEADER]: Becoming Leader. State: Replica: 96495451785940faae778d1e15166296, State: Running, Role: LEADER
I20260808 08:40:21.299755 23708 consensus_queue.cc:237] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } }
I20260808 08:40:21.305509 22868 catalog_manager.cc:5495] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96495451785940faae778d1e15166296 (127.19.242.194). New cstate: current_term: 1 leader_uuid: "96495451785940faae778d1e15166296" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96495451785940faae778d1e15166296" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 } health_report { overall_health: UNKNOWN } } }
I20260808 08:40:21.362860 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.352550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.19.242.194:39463)
0808 08:40:21.354064 (+ 1514us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:21.354069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:21.354111 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:40:21.354241 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:21.354246 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:21.354381 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:21.354582 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:21.355385 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.356901 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.359166 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.359942 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.360112 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.360913 (+ 801us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:21.361656 (+ 743us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:21.361780 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:21.362222 (+ 442us) server_negotiation.cc:299] Negotiation successful
0808 08:40:21.362314 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1347,"thread_start_us":1040,"threads_started":1}
I20260808 08:40:21.390553 23711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.379572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:35027 (local address 127.19.242.195:38099)
0808 08:40:21.379763 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:21.379768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:21.381345 (+ 1577us) server_negotiation.cc:407] Connection header received
0808 08:40:21.381643 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:21.381648 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:21.381775 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:21.381894 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:21.383073 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.384164 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.387320 (+ 3156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.388131 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.388371 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.389120 (+ 749us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:21.389323 (+ 203us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:21.389459 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:21.389637 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 08:40:21.389801 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:40:21.390873 23733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.379766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38099 (local address 127.19.242.194:35027)
0808 08:40:21.381214 (+ 1448us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:21.381231 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:21.381463 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:21.381913 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:21.381918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:21.381930 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:21.382801 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.382815 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.384564 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.384571 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.387113 (+ 2542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.387134 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.388466 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.388477 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.388726 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.388834 (+ 108us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:21.389469 (+ 635us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:21.389486 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 08:40:21.389607 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:40:21.389821 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1188,"thread_start_us":804,"threads_started":1}
I20260808 08:40:21.401844 23472 raft_consensus.cc:1261] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Refusing update from remote peer 96495451785940faae778d1e15166296: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:21.402040 23083 raft_consensus.cc:1261] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Refusing update from remote peer 96495451785940faae778d1e15166296: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:21.402981 23726 consensus_queue.cc:1035] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37be5733720340cb87e675d9bc94ac49" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:21.403529 23708 consensus_queue.cc:1035] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de58e9a195b4796bf9f059317bca726" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:21.411918 23660 mvcc.cc:205] Tried to move back new op lower bound from 7316186814054178816 to 7316186813649162240. Current Snapshot: MvccSnapshot[applied={T|T < 7316186814054178816}]
I20260808 08:40:21.446760 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.437079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:42511 (local address 127.19.242.194:39463)
0808 08:40:21.437392 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:21.437408 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:21.438199 (+ 791us) server_negotiation.cc:407] Connection header received
0808 08:40:21.438456 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:21.438460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:21.438546 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:21.438643 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:21.440275 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.441598 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.443990 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.444863 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.445026 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.445709 (+ 683us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:21.445862 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:21.445961 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:21.446127 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:40:21.446219 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260808 08:40:21.447027 23741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:21.436866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:39463 (local address 127.19.242.195:42511)
0808 08:40:21.438057 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:21.438075 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:21.438238 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:21.438680 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:21.438685 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:21.438699 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:40:21.439999 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.440015 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.441804 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.441809 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.443810 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:21.443827 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:21.445193 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:21.445202 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:21.445418 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:21.445464 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:40:21.445966 (+ 502us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:40:21.445982 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 08:40:21.446100 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:40:21.446260 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"thread_start_us":787,"threads_started":1}
W20260808 08:40:21.448421 23660 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:40:23.064952 22867 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:23.065366 22867 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:23.070654 22867 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9c00633874f4448ac4aa4725b00b26b: Sending DeleteTablet for 3 replicas of tablet 677c3fe0876248e6b58a2d2eb75b64b3
I20260808 08:40:23.071798 23055 tablet_service.cc:1514] Processing DeleteTablet for tablet 677c3fe0876248e6b58a2d2eb75b64b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:23 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:49792
I20260808 08:40:23.071909 23243 tablet_service.cc:1514] Processing DeleteTablet for tablet 677c3fe0876248e6b58a2d2eb75b64b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:23 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:40114
I20260808 08:40:23.072480 23437 tablet_service.cc:1514] Processing DeleteTablet for tablet 677c3fe0876248e6b58a2d2eb75b64b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:23 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:55386
I20260808 08:40:23.072645 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22970
I20260808 08:40:23.072707 23782 tablet_replica.cc:330] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: stopping tablet replica
I20260808 08:40:23.073029 23782 raft_consensus.cc:2229] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:23.073185 23783 tablet_replica.cc:330] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: stopping tablet replica
I20260808 08:40:23.073400 23783 raft_consensus.cc:2229] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:23.073621 23782 raft_consensus.cc:2258] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:23.074056 23783 raft_consensus.cc:2258] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:23.075141 23782 ts_tablet_manager.cc:1905] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:23.075659 23783 ts_tablet_manager.cc:1905] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:23.077880 23784 tablet_replica.cc:330] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: stopping tablet replica
I20260808 08:40:23.078210 23784 raft_consensus.cc:2229] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:23.078569 23784 raft_consensus.cc:2258] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:23.079881 23784 ts_tablet_manager.cc:1905] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:23.083186 23783 ts_tablet_manager.cc:1918] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:40:23.083369 23783 log.cc:1196] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/677c3fe0876248e6b58a2d2eb75b64b3
I20260808 08:40:23.083420 23782 ts_tablet_manager.cc:1918] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:40:23.083808 23782 log.cc:1196] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/677c3fe0876248e6b58a2d2eb75b64b3
I20260808 08:40:23.083900 23783 ts_tablet_manager.cc:1939] T 677c3fe0876248e6b58a2d2eb75b64b3 P 96495451785940faae778d1e15166296: Deleting consensus metadata
I20260808 08:40:23.084414 23782 ts_tablet_manager.cc:1939] T 677c3fe0876248e6b58a2d2eb75b64b3 P 4de58e9a195b4796bf9f059317bca726: Deleting consensus metadata
I20260808 08:40:23.085372 22855 catalog_manager.cc:4841] TS 96495451785940faae778d1e15166296 (127.19.242.194:39463): tablet 677c3fe0876248e6b58a2d2eb75b64b3 (table test-table [id=8de6f40eabea4c5fa1e8dfcac8cde7ea]) successfully deleted
I20260808 08:40:23.085752 22855 catalog_manager.cc:4841] TS 4de58e9a195b4796bf9f059317bca726 (127.19.242.193:41853): tablet 677c3fe0876248e6b58a2d2eb75b64b3 (table test-table [id=8de6f40eabea4c5fa1e8dfcac8cde7ea]) successfully deleted
I20260808 08:40:23.087502 23784 ts_tablet_manager.cc:1918] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:40:23.087638 23784 log.cc:1196] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/677c3fe0876248e6b58a2d2eb75b64b3
I20260808 08:40:23.088194 23784 ts_tablet_manager.cc:1939] T 677c3fe0876248e6b58a2d2eb75b64b3 P 37be5733720340cb87e675d9bc94ac49: Deleting consensus metadata
I20260808 08:40:23.089298 22855 catalog_manager.cc:4841] TS 37be5733720340cb87e675d9bc94ac49 (127.19.242.195:38099): tablet 677c3fe0876248e6b58a2d2eb75b64b3 (table test-table [id=8de6f40eabea4c5fa1e8dfcac8cde7ea]) successfully deleted
Aug 08 08:40:23 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:23.098088 23786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:23.075185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51680 (local address 127.19.242.193:41853)
0808 08:40:23.079339 (+ 4154us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:23.079345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:23.079370 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:40:23.079444 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:23.079449 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:23.079551 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:23.081650 (+ 2099us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:23.081846 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:23.083121 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:23.085174 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:23.085945 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:23.086179 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:23.090902 (+ 4723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:23.090921 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:23.090940 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:23.090998 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:23.094606 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:23.095589 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:23.095598 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:23.095601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:23.095799 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:23.096298 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:23.096304 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:23.096307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:23.096851 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:23.097094 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:23.097459 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 08:40:23.097666 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3996,"thread_start_us":3828,"threads_started":1}
W20260808 08:40:23.098927 23141 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51680
W20260808 08:40:23.099807 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22970: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:23.100085 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 22970
I20260808 08:40:23.146548 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 23157
Aug 08 08:40:23 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:23.166085 23787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:23.147578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49020 (local address 127.19.242.194:39463)
0808 08:40:23.148331 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:23.148336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:23.148355 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:40:23.148415 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:23.148419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:23.148484 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:23.148585 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:23.150286 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:23.151217 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:23.152633 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:23.153204 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:23.153348 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:23.158644 (+ 5296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:23.158664 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:23.158684 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:23.158825 (+ 141us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:23.162335 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:23.163426 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:23.163437 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:23.163440 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:23.163687 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:23.164169 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:23.164174 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:23.164177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:23.164693 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:23.164974 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:23.165326 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 08:40:23.165589 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":409,"threads_started":1}
W20260808 08:40:23.167373 23333 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49020
W20260808 08:40:23.168191 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 23157: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:23.168383 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 23157
I20260808 08:40:23.207279 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 23342
Aug 08 08:40:23 dist-test-slave-39l8 krb5kdc[22816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:23.225627 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:23.208139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58618 (local address 127.19.242.195:38099)
0808 08:40:23.208776 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:23.208780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:23.208798 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:40:23.208857 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:23.208861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:23.208925 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:23.209029 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:23.210524 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:23.211656 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:23.213172 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:23.213705 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:23.213845 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:23.219024 (+ 5179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:23.219043 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:23.219061 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:23.219228 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:23.222302 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:23.223248 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:23.223258 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:23.223260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:23.223432 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:23.223856 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:23.223861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:23.223863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:23.224383 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:23.224671 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:23.224976 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 08:40:23.225188 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":337,"threads_started":1}
W20260808 08:40:23.226446 23529 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58618
W20260808 08:40:23.227483 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 23342: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:23.227698 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 23342
I20260808 08:40:23.273044 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 22830
I20260808 08:40:23.274688 22930 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:23.399089 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 22830
2026-08-08T08:40:23Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9935 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:24 dist-test-slave-39l8 krb5kdc[23792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:24 dist-test-slave-39l8 krb5kdc[23792](info): set up 2 sockets
Aug 08 08:40:24 dist-test-slave-39l8 krb5kdc[23792](info): commencing operation
krb5kdc: starting...
W20260808 08:40:25.915031 20427 mini_kdc.cc:121] Time spent starting KDC: real 2.452s user 0.002s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:26 dist-test-slave-39l8 krb5kdc[23792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:26.175086 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35805
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:42133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:35805
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:26.536137 23813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:26.536552 23813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:26.536717 23813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:26.544402 23813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:26.544601 23813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:26.544720 23813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:26.544826 23813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:26.544911 23813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:26.555594 23813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:42133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:35805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:26.557185 23813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:26.558672 23813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:26.572227 23818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:26.572309 23822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:26.572284 23820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:26.572933 23813 server_base.cc:1034] running on GCE node
I20260808 08:40:26.573982 23813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:26.575732 23813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:26.577004 23813 hybrid_clock.cc:648] HybridClock initialized: now 1786178426576917 us; error 66 us; skew 500 ppm
I20260808 08:40:26.577512 23813 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:26 dist-test-slave-39l8 krb5kdc[23792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178426, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:26.586370 23813 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:26.588475 23813 webserver.cc:460] Webserver started at http://127.19.242.254:45247/ using document root <none> and password file <none>
I20260808 08:40:26.589308 23813 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:26.589488 23813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:26.589869 23813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:26.593300 23813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "d48dc8d44cf34db5a774e54687d8045f"
format_stamp: "Formatted at 2026-08-08 08:40:26 on dist-test-slave-39l8"
server_key: "715d15737cb3c87bdf7893205f8532de"
server_key_iv: "5c79ccac1f00c48be01d0f39b34d6aeb"
server_key_version: "encryptionkey@0"
I20260808 08:40:26.594138 23813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "d48dc8d44cf34db5a774e54687d8045f"
format_stamp: "Formatted at 2026-08-08 08:40:26 on dist-test-slave-39l8"
server_key: "715d15737cb3c87bdf7893205f8532de"
server_key_iv: "5c79ccac1f00c48be01d0f39b34d6aeb"
server_key_version: "encryptionkey@0"
I20260808 08:40:26.600414 23813 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 08:40:26.604642 23829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:26.606315 23813 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:40:26.606564 23813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "d48dc8d44cf34db5a774e54687d8045f"
format_stamp: "Formatted at 2026-08-08 08:40:26 on dist-test-slave-39l8"
server_key: "715d15737cb3c87bdf7893205f8532de"
server_key_iv: "5c79ccac1f00c48be01d0f39b34d6aeb"
server_key_version: "encryptionkey@0"
I20260808 08:40:26.606894 23813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:26.633191 23813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:26.638477 23813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:26.638881 23813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:26.660068 23813 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:35805
I20260808 08:40:26.660125 23901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:35805 every 8 connection(s)
I20260808 08:40:26.661692 23813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:26.666121 23902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:26.671847 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 23813
I20260808 08:40:26.672230 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:26.672969 20427 external_mini_cluster.cc:1428] Setting key 5b773f595699e251f552b90a75af18f4
I20260808 08:40:26.680570 23902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f: Bootstrap starting.
I20260808 08:40:26.685122 23902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:26.686328 23902 log.cc:824] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:26.690214 23902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f: No bootstrap required, opened a new log
Aug 08 08:40:26 dist-test-slave-39l8 krb5kdc[23792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178426, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:26.702840 23902 raft_consensus.cc:348] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48dc8d44cf34db5a774e54687d8045f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35805 } }
I20260808 08:40:26.703425 23902 raft_consensus.cc:374] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:26.703559 23902 raft_consensus.cc:729] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d48dc8d44cf34db5a774e54687d8045f, State: Initialized, Role: FOLLOWER
I20260808 08:40:26.704145 23905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:26.675549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41794 (local address 127.19.242.254:35805)
0808 08:40:26.676691 (+ 1142us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:26.676715 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:26.676781 (+ 66us) server_negotiation.cc:407] Connection header received
0808 08:40:26.679655 (+ 2874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:26.679690 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:26.680359 (+ 669us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:26.680904 (+ 545us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:26.682538 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:26.684823 (+ 2285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:26.686460 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:26.687720 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:26.687914 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:26.692987 (+ 5073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:26.693001 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:26.693032 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:26.693110 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:26.697980 (+ 4870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:26.699090 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:26.699102 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:26.699113 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:26.699401 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:26.699929 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:26.699935 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:26.699938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:26.700910 (+ 972us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:26.701279 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:26.701783 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 08:40:26.702346 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":516,"threads_started":1}
I20260808 08:40:26.704368 23902 consensus_queue.cc:260] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48dc8d44cf34db5a774e54687d8045f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35805 } }
I20260808 08:40:26.704766 23902 raft_consensus.cc:388] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:26.704949 23902 raft_consensus.cc:482] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:26.705176 23902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:26.708423 23902 raft_consensus.cc:504] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48dc8d44cf34db5a774e54687d8045f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35805 } }
I20260808 08:40:26.709009 23902 leader_election.cc:302] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d48dc8d44cf34db5a774e54687d8045f; no voters:
I20260808 08:40:26.709635 23902 leader_election.cc:288] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:26.709810 23910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:26.710604 23910 raft_consensus.cc:686] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [term 1 LEADER]: Becoming Leader. State: Replica: d48dc8d44cf34db5a774e54687d8045f, State: Running, Role: LEADER
I20260808 08:40:26.711313 23910 consensus_queue.cc:237] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48dc8d44cf34db5a774e54687d8045f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35805 } }
I20260808 08:40:26.712188 23902 sys_catalog.cc:564] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:26.714681 23911 sys_catalog.cc:455] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d48dc8d44cf34db5a774e54687d8045f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48dc8d44cf34db5a774e54687d8045f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35805 } } }
I20260808 08:40:26.715270 23911 sys_catalog.cc:458] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:26.715342 23912 sys_catalog.cc:455] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d48dc8d44cf34db5a774e54687d8045f. Latest consensus state: current_term: 1 leader_uuid: "d48dc8d44cf34db5a774e54687d8045f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d48dc8d44cf34db5a774e54687d8045f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35805 } } }
I20260808 08:40:26.718165 23912 sys_catalog.cc:458] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:26.724890 23916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:26.730453 23916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:26.740876 23916 catalog_manager.cc:1347] Generated new cluster ID: 56e2259266f046ae823600cc70a51fff
I20260808 08:40:26.741084 23916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:26.766521 23916 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:26.768607 23916 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:26.782112 23916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d48dc8d44cf34db5a774e54687d8045f: Generated new TSK 0
I20260808 08:40:26.783440 23916 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:26.851492 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35805
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:42133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:27.224963 23937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:27.225443 23937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:27.225564 23937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:27.233294 23937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:27.233444 23937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:27.233564 23937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:27.244273 23937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:42133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:27.245694 23937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:27.247184 23937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:27.262358 23942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:27.262295 23946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:27.262883 23943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:27.263528 23937 server_base.cc:1034] running on GCE node
I20260808 08:40:27.264263 23937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:27.265393 23937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:27.266768 23937 hybrid_clock.cc:648] HybridClock initialized: now 1786178427266636 us; error 70 us; skew 500 ppm
I20260808 08:40:27.267174 23937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:27 dist-test-slave-39l8 krb5kdc[23792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178427, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:27.270882 23937 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:27.272737 23937 webserver.cc:460] Webserver started at http://127.19.242.193:39341/ using document root <none> and password file <none>
I20260808 08:40:27.273550 23937 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:27.273720 23937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:27.274080 23937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:27.277467 23937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "a1fa02970e424babafa6edf93235ab64"
format_stamp: "Formatted at 2026-08-08 08:40:27 on dist-test-slave-39l8"
server_key: "eee856eb3b31d760071dacd1e49c0194"
server_key_iv: "1b4f82ca6fbebd4f329e2138805286d5"
server_key_version: "encryptionkey@0"
I20260808 08:40:27.278579 23937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "a1fa02970e424babafa6edf93235ab64"
format_stamp: "Formatted at 2026-08-08 08:40:27 on dist-test-slave-39l8"
server_key: "eee856eb3b31d760071dacd1e49c0194"
server_key_iv: "1b4f82ca6fbebd4f329e2138805286d5"
server_key_version: "encryptionkey@0"
I20260808 08:40:27.285377 23937 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 08:40:27.289826 23953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:27.291577 23937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:27.291800 23937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "a1fa02970e424babafa6edf93235ab64"
format_stamp: "Formatted at 2026-08-08 08:40:27 on dist-test-slave-39l8"
server_key: "eee856eb3b31d760071dacd1e49c0194"
server_key_iv: "1b4f82ca6fbebd4f329e2138805286d5"
server_key_version: "encryptionkey@0"
I20260808 08:40:27.292096 23937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:27.313264 23937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:27.318419 23937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:27.318794 23937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:27.319916 23937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:27.321689 23937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:27.321805 23937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:27.321916 23937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:27.321969 23937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:27.358800 23937 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:42821
I20260808 08:40:27.358896 24111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:42821 every 8 connection(s)
I20260808 08:40:27.360241 23937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:27.369412 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 23937
I20260808 08:40:27.369741 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:27.370463 20427 external_mini_cluster.cc:1428] Setting key c4c27cc1111bfd4a2d3786fbceb62bbe
Aug 08 08:40:27 dist-test-slave-39l8 krb5kdc[23792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178427, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:27.384053 24115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:27.363297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:40079 (local address 127.19.242.254:35805)
0808 08:40:27.363772 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:27.363777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:27.364968 (+ 1191us) server_negotiation.cc:407] Connection header received
0808 08:40:27.367062 (+ 2094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:27.367068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:27.367172 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:27.367307 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:27.369069 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.369917 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.371742 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.372214 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.372362 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:27.377069 (+ 4707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:27.377075 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:27.377079 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:27.377119 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:27.380337 (+ 3218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:27.381324 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:27.381329 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:27.381331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:27.381477 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:27.381995 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:27.381999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:27.382001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:27.382317 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:27.382490 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:27.383561 (+ 1071us) server_negotiation.cc:299] Negotiation successful
0808 08:40:27.383775 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":224,"threads_started":1}
I20260808 08:40:27.385725 24116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:27.363936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35805 (local address 127.19.242.193:40079)
0808 08:40:27.364764 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:27.364811 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:27.366674 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:27.367590 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:27.367600 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:27.368195 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:27.368860 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:27.368882 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.370113 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.370117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:27.371564 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:27.371579 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.372498 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.372507 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:27.372905 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:27.373840 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:27.373873 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:27.376760 (+ 2887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:27.380561 (+ 3801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:27.380573 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:27.380598 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:27.381148 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:27.381615 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:27.381619 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:27.381623 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:27.381851 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:27.382466 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:27.382476 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:27.383057 (+ 581us) client_negotiation.cc:769] Sending connection context
0808 08:40:27.383403 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 08:40:27.384066 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":313,"threads_started":1}
I20260808 08:40:27.387738 24113 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35805
I20260808 08:40:27.388166 24113 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:27.389047 24113 heartbeater.cc:511] Master 127.19.242.254:35805 requested a full tablet report, sending...
I20260808 08:40:27.391695 23857 ts_manager.cc:194] Registered new tserver with Master: a1fa02970e424babafa6edf93235ab64 (127.19.242.193:42821)
I20260808 08:40:27.393468 23857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:40079
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:27.428462 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35805
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:42133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:27.797030 24119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:27.797405 24119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:27.797572 24119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:27.805388 24119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:27.805575 24119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:27.805763 24119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:27.816774 24119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:42133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:27.818313 24119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:27.819811 24119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:27.835309 24126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:27.835321 24129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:27.835850 24125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:27.837368 24119 server_base.cc:1034] running on GCE node
I20260808 08:40:27.838138 24119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:27.839365 24119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:27.840597 24119 hybrid_clock.cc:648] HybridClock initialized: now 1786178427840540 us; error 46 us; skew 500 ppm
I20260808 08:40:27.840977 24119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:27 dist-test-slave-39l8 krb5kdc[23792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178427, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:27.844939 24119 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:27.846956 24119 webserver.cc:460] Webserver started at http://127.19.242.194:44261/ using document root <none> and password file <none>
I20260808 08:40:27.848069 24119 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:27.848206 24119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:27.848527 24119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:27.852167 24119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "597de1f989b64cb097b57a75732900ab"
format_stamp: "Formatted at 2026-08-08 08:40:27 on dist-test-slave-39l8"
server_key: "f9358f22ef3fbc2d1588edf47a153094"
server_key_iv: "c9902034041e10158bbf92798d738e4e"
server_key_version: "encryptionkey@0"
I20260808 08:40:27.853114 24119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "597de1f989b64cb097b57a75732900ab"
format_stamp: "Formatted at 2026-08-08 08:40:27 on dist-test-slave-39l8"
server_key: "f9358f22ef3fbc2d1588edf47a153094"
server_key_iv: "c9902034041e10158bbf92798d738e4e"
server_key_version: "encryptionkey@0"
I20260808 08:40:27.859812 24119 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:40:27.864728 24138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:27.866460 24119 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:40:27.866741 24119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "597de1f989b64cb097b57a75732900ab"
format_stamp: "Formatted at 2026-08-08 08:40:27 on dist-test-slave-39l8"
server_key: "f9358f22ef3fbc2d1588edf47a153094"
server_key_iv: "c9902034041e10158bbf92798d738e4e"
server_key_version: "encryptionkey@0"
I20260808 08:40:27.867017 24119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:27.929459 24119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:27.935395 24119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:27.935742 24119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:27.936856 24119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:27.938400 24119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:27.938488 24119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:27.938632 24119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:27.938687 24119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:27.976487 24119 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:38929
I20260808 08:40:27.976593 24289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:38929 every 8 connection(s)
I20260808 08:40:27.977941 24119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:27.986569 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 24119
I20260808 08:40:27.986865 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:27.987313 20427 external_mini_cluster.cc:1428] Setting key d31fa508c51596073fa2c7de503f1abe
Aug 08 08:40:27 dist-test-slave-39l8 krb5kdc[23792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178427, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:28.002115 24293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:27.981068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:58723 (local address 127.19.242.254:35805)
0808 08:40:27.981632 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:27.981637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:27.982522 (+ 885us) server_negotiation.cc:407] Connection header received
0808 08:40:27.984535 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:27.984543 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:27.984645 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:27.984769 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:27.986717 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.987627 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.989763 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.990295 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.990399 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:27.995520 (+ 5121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:27.995526 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:27.995529 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:27.995572 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:27.998553 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:27.999523 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:27.999535 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:27.999537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:27.999674 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:28.000191 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:28.000196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:28.000198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:28.000491 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:28.000659 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:28.001468 (+ 809us) server_negotiation.cc:299] Negotiation successful
0808 08:40:28.001730 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":335,"threads_started":1}
I20260808 08:40:28.003489 24294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:27.981557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35805 (local address 127.19.242.194:58723)
0808 08:40:27.982330 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:27.982384 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:27.984227 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:27.985038 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:27.985047 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:27.985650 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:27.986417 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:27.986455 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.987824 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.987830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:27.989573 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:27.989594 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:27.990559 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:27.990578 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:27.991004 (+ 426us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:27.991912 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:27.991950 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:27.995178 (+ 3228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:27.998810 (+ 3632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:27.998826 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:27.998842 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:27.999368 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:27.999801 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:27.999806 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:27.999809 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:28.000041 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:28.000633 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:28.000643 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:28.001052 (+ 409us) client_negotiation.cc:769] Sending connection context
0808 08:40:28.001343 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 08:40:28.001981 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":292,"threads_started":1}
I20260808 08:40:28.005188 24290 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35805
I20260808 08:40:28.005540 24290 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:28.006346 24290 heartbeater.cc:511] Master 127.19.242.254:35805 requested a full tablet report, sending...
I20260808 08:40:28.008069 23857 ts_manager.cc:194] Registered new tserver with Master: 597de1f989b64cb097b57a75732900ab (127.19.242.194:38929)
I20260808 08:40:28.008975 23857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:58723
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:28.046003 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35805
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:42133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:40:28.397367 24113 heartbeater.cc:503] Master 127.19.242.254:35805 was elected leader, sending a full tablet report...
W20260808 08:40:28.416810 24297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:28.417182 24297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:28.417352 24297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:28.425302 24297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:28.425483 24297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:28.425673 24297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:28.436275 24297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:42133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35805
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:28.437814 24297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:28.439402 24297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:28.454195 24304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:28.454193 24305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:28.454173 24308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:28.454917 24297 server_base.cc:1034] running on GCE node
I20260808 08:40:28.455770 24297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:28.456885 24297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:28.458189 24297 hybrid_clock.cc:648] HybridClock initialized: now 1786178428458144 us; error 72 us; skew 500 ppm
I20260808 08:40:28.458609 24297 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:28 dist-test-slave-39l8 krb5kdc[23792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178428, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:28.462083 24297 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:28.463828 24297 webserver.cc:460] Webserver started at http://127.19.242.195:45073/ using document root <none> and password file <none>
I20260808 08:40:28.464588 24297 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:28.464699 24297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:28.464982 24297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:28.468330 24297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "60e3c162c0c846ca8e038415816dfa4d"
format_stamp: "Formatted at 2026-08-08 08:40:28 on dist-test-slave-39l8"
server_key: "1c8309a997b69114904240bfdd897703"
server_key_iv: "174dae15d891c58ae502025d064f4ed5"
server_key_version: "encryptionkey@0"
I20260808 08:40:28.469183 24297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "60e3c162c0c846ca8e038415816dfa4d"
format_stamp: "Formatted at 2026-08-08 08:40:28 on dist-test-slave-39l8"
server_key: "1c8309a997b69114904240bfdd897703"
server_key_iv: "174dae15d891c58ae502025d064f4ed5"
server_key_version: "encryptionkey@0"
I20260808 08:40:28.475184 24297 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:40:28.479187 24317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:28.480826 24297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:40:28.481055 24297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "60e3c162c0c846ca8e038415816dfa4d"
format_stamp: "Formatted at 2026-08-08 08:40:28 on dist-test-slave-39l8"
server_key: "1c8309a997b69114904240bfdd897703"
server_key_iv: "174dae15d891c58ae502025d064f4ed5"
server_key_version: "encryptionkey@0"
I20260808 08:40:28.481289 24297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:28.496549 24297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:28.501552 24297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:28.501858 24297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:28.503037 24297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:28.504562 24297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:28.504684 24297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:28.504812 24297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:28.504861 24297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:28.542228 24297 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:40071
I20260808 08:40:28.542286 24476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:40071 every 8 connection(s)
I20260808 08:40:28.543731 24297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:28.553400 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 24297
I20260808 08:40:28.553620 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:28.554065 20427 external_mini_cluster.cc:1428] Setting key 36a92383bd9cbb3eba686a95f7a35d29
Aug 08 08:40:28 dist-test-slave-39l8 krb5kdc[23792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178428, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:28.566265 24481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:28.546508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:52575 (local address 127.19.242.254:35805)
0808 08:40:28.547066 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:28.547073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:28.548215 (+ 1142us) server_negotiation.cc:407] Connection header received
0808 08:40:28.550107 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:28.550112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:28.550188 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:28.550303 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:28.552172 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:28.553095 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:28.555058 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:28.555607 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:28.555756 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:28.559842 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:28.559847 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:28.559850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:28.559888 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:28.562952 (+ 3064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:28.563939 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:28.563945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:28.563947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:28.564084 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:28.564559 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:28.564562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:28.564564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:28.564859 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:28.564986 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:28.565785 (+ 799us) server_negotiation.cc:299] Negotiation successful
0808 08:40:28.565974 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":267,"threads_started":1}
I20260808 08:40:28.567396 24482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:28.547158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35805 (local address 127.19.242.195:52575)
0808 08:40:28.548023 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:28.548075 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:28.549814 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:28.550572 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:28.550582 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:28.551255 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:28.551910 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:28.551931 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:28.553280 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:28.553284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:28.554910 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:28.554925 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:28.555872 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:28.555878 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:28.556143 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:28.556952 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:28.556988 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:28.559576 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:28.563201 (+ 3625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:28.563228 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:28.563258 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:28.563780 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:28.564227 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:28.564231 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:28.564233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:28.564436 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:28.564970 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:28.564976 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:28.565401 (+ 425us) client_negotiation.cc:769] Sending connection context
0808 08:40:28.565646 (+ 245us) client_negotiation.cc:240] Negotiation successful
0808 08:40:28.566076 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":358,"threads_started":1}
I20260808 08:40:28.569116 24477 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35805
I20260808 08:40:28.569464 24477 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:28.570248 24477 heartbeater.cc:511] Master 127.19.242.254:35805 requested a full tablet report, sending...
I20260808 08:40:28.571892 23857 ts_manager.cc:194] Registered new tserver with Master: 60e3c162c0c846ca8e038415816dfa4d (127.19.242.195:40071)
I20260808 08:40:28.572902 23857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:52575
I20260808 08:40:28.583329 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:40:28.627115 24481 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:28.623735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41796 (local address 127.19.242.254:35805)
0808 08:40:28.623985 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:28.623994 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:28.624430 (+ 436us) server_negotiation.cc:407] Connection header received
0808 08:40:28.624912 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:28.624917 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:28.625049 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:28.625184 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:28.626765 (+ 1581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41796: BlockingRecv error: recv got EOF from 127.0.0.1:41796 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:40:28.630540 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 23937
W20260808 08:40:28.633690 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 23937: Not authorized: Client connection negotiation failed: client connection to 127.19.242.193:42821: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:40:28.633908 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 23937
I20260808 08:40:28.660312 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24119
W20260808 08:40:28.663513 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24119: Not authorized: Client connection negotiation failed: client connection to 127.19.242.194:38929: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:40:28.663720 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 24119
I20260808 08:40:28.688593 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24297
W20260808 08:40:28.692126 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24297: Not authorized: Client connection negotiation failed: client connection to 127.19.242.195:40071: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:40:28.692291 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 24297
I20260808 08:40:28.720227 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 23813
I20260808 08:40:28.721802 23897 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:28.827090 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 23813
2026-08-08T08:40:28Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (5418 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:28 dist-test-slave-39l8 krb5kdc[24503](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:28 dist-test-slave-39l8 krb5kdc[24503](info): set up 2 sockets
Aug 08 08:40:28 dist-test-slave-39l8 krb5kdc[24503](info): commencing operation
krb5kdc: starting...
W20260808 08:40:30.159426 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.003s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:30 dist-test-slave-39l8 krb5kdc[24503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:30.418670 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36269
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:30.795351 24523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:30.795684 24523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:30.795779 24523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:30.803336 24523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:30.803470 24523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:30.803517 24523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:30.803578 24523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:30.803627 24523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:30.813911 24523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:30.815354 24523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:30.816884 24523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:30.830138 24530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:30.830298 24532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:30.830281 24529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:30.831729 24523 server_base.cc:1034] running on GCE node
I20260808 08:40:30.832796 24523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:30.834457 24523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:30.835741 24523 hybrid_clock.cc:648] HybridClock initialized: now 1786178430835679 us; error 57 us; skew 500 ppm
I20260808 08:40:30.836210 24523 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:30 dist-test-slave-39l8 krb5kdc[24503](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178430, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:30.839970 24523 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:30.841908 24523 webserver.cc:460] Webserver started at http://127.19.242.254:36855/ using document root <none> and password file <none>
I20260808 08:40:30.842844 24523 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:30.843014 24523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:30.843397 24523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:30.847064 24523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "fe062c605708425dac64fd6f2218e718"
format_stamp: "Formatted at 2026-08-08 08:40:30 on dist-test-slave-39l8"
server_key: "bd9b2e5703039d02734deddadab95c38"
server_key_iv: "c1eb5a163ed6986ed3288f1d8f447a87"
server_key_version: "encryptionkey@0"
I20260808 08:40:30.848100 24523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "fe062c605708425dac64fd6f2218e718"
format_stamp: "Formatted at 2026-08-08 08:40:30 on dist-test-slave-39l8"
server_key: "bd9b2e5703039d02734deddadab95c38"
server_key_iv: "c1eb5a163ed6986ed3288f1d8f447a87"
server_key_version: "encryptionkey@0"
I20260808 08:40:30.854839 24523 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 08:40:30.859414 24545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:30.861327 24523 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:40:30.861564 24523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "fe062c605708425dac64fd6f2218e718"
format_stamp: "Formatted at 2026-08-08 08:40:30 on dist-test-slave-39l8"
server_key: "bd9b2e5703039d02734deddadab95c38"
server_key_iv: "c1eb5a163ed6986ed3288f1d8f447a87"
server_key_version: "encryptionkey@0"
I20260808 08:40:30.861806 24523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:30.879406 24523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:30.884320 24523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:30.884651 24523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:30.905994 24523 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36269
I20260808 08:40:30.905956 24611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36269 every 8 connection(s)
I20260808 08:40:30.907744 24523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:30.912091 24612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:30.918061 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 24523
I20260808 08:40:30.918358 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:30.919122 20427 external_mini_cluster.cc:1428] Setting key 97b1047d2929b7285967c7f0f0937612
I20260808 08:40:30.924525 24612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718: Bootstrap starting.
I20260808 08:40:30.928179 24612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:30.929426 24612 log.cc:824] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:30.933254 24612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718: No bootstrap required, opened a new log
Aug 08 08:40:30 dist-test-slave-39l8 krb5kdc[24503](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:30.944097 24612 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe062c605708425dac64fd6f2218e718" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36269 } }
I20260808 08:40:30.944681 24612 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:30.944818 24612 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe062c605708425dac64fd6f2218e718, State: Initialized, Role: FOLLOWER
I20260808 08:40:30.945602 24612 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe062c605708425dac64fd6f2218e718" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36269 } }
I20260808 08:40:30.945950 24612 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:30.946105 24612 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:30.946303 24612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:30.946779 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:30.921283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54410 (local address 127.19.242.254:36269)
0808 08:40:30.922301 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:30.922314 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:30.922366 (+ 52us) server_negotiation.cc:407] Connection header received
0808 08:40:30.924306 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:30.924335 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:30.924839 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:30.925282 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:30.927070 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:30.928517 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:30.930506 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:30.931584 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:30.931821 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:30.936635 (+ 4814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:30.936648 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:30.936680 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:30.936753 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:30.941256 (+ 4503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:30.942184 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:30.942199 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:30.942212 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:30.942468 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:30.942964 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:30.942969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:30.942973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:30.943809 (+ 836us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:30.944101 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:30.944658 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 08:40:30.945183 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":426,"threads_started":1}
I20260808 08:40:30.949093 24612 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe062c605708425dac64fd6f2218e718" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36269 } }
I20260808 08:40:30.949723 24612 leader_election.cc:302] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe062c605708425dac64fd6f2218e718; no voters:
I20260808 08:40:30.950471 24612 leader_election.cc:288] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:30.950639 24619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:30.951658 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:40:30.952656 24612 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:30.959071 24619 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [term 1 LEADER]: Becoming Leader. State: Replica: fe062c605708425dac64fd6f2218e718, State: Running, Role: LEADER
I20260808 08:40:30.959898 24619 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe062c605708425dac64fd6f2218e718" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36269 } }
I20260808 08:40:30.964197 24621 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe062c605708425dac64fd6f2218e718" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe062c605708425dac64fd6f2218e718" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36269 } } }
I20260808 08:40:30.964643 24621 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:30.965204 24622 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe062c605708425dac64fd6f2218e718. Latest consensus state: current_term: 1 leader_uuid: "fe062c605708425dac64fd6f2218e718" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe062c605708425dac64fd6f2218e718" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36269 } } }
I20260808 08:40:30.965569 24622 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718 [sys.catalog]: This master's current role is: LEADER
W20260808 08:40:30.972954 24640 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:40:30.973182 24640 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:40:30.973368 24636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:30.975401 24636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:30.987712 24636 catalog_manager.cc:1347] Generated new cluster ID: 5cf262c0951c44acb11be1ca0013e9e9
I20260808 08:40:30.987943 24636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:31.010879 24636 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:31.013792 24636 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:31.016893 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:31.005199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54422 (local address 127.19.242.254:36269)
0808 08:40:31.005459 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:31.005469 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:31.006169 (+ 700us) server_negotiation.cc:407] Connection header received
0808 08:40:31.006417 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:31.006422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:31.006499 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:31.006631 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:31.007839 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:31.008602 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:31.010849 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:31.011533 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:31.011685 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:31.013886 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:31.013925 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:31.013931 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:31.015478 (+ 1547us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:31.015592 (+ 114us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:31.015667 (+ 75us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:31.015819 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:31.016202 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 08:40:31.016423 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:40:31.027202 24636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe062c605708425dac64fd6f2218e718: Generated new TSK 0
I20260808 08:40:31.028549 24636 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:40:31.045706 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24523
I20260808 08:40:31.047307 24606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:31.144399 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 24523
2026-08-08T08:40:31Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2310 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:31 dist-test-slave-39l8 krb5kdc[24656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:31 dist-test-slave-39l8 krb5kdc[24656](info): set up 2 sockets
Aug 08 08:40:31 dist-test-slave-39l8 krb5kdc[24656](info): commencing operation
krb5kdc: starting...
W20260808 08:40:32.465498 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.005s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:32 dist-test-slave-39l8 krb5kdc[24656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:32.720876 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36853
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36853
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:33.082664 24673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:33.083098 24673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:33.083204 24673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:33.091025 24673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:33.091215 24673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:33.091265 24673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:33.091324 24673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:33.091379 24673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:33.102222 24673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36853
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:33.103698 24673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:33.105110 24673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:33.118906 24682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:33.118975 24685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:33.118934 24687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:33.120105 24673 server_base.cc:1034] running on GCE node
I20260808 08:40:33.121029 24673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:33.122792 24673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:33.124065 24673 hybrid_clock.cc:648] HybridClock initialized: now 1786178433124007 us; error 54 us; skew 500 ppm
I20260808 08:40:33.124473 24673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:33 dist-test-slave-39l8 krb5kdc[24656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178433, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:33.133883 24673 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:33.135864 24673 webserver.cc:460] Webserver started at http://127.19.242.254:42449/ using document root <none> and password file <none>
I20260808 08:40:33.136689 24673 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:33.136857 24673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:33.137205 24673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:33.140626 24673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "b17adabc4f45475bb1c9a04ab578f3aa"
format_stamp: "Formatted at 2026-08-08 08:40:33 on dist-test-slave-39l8"
server_key: "eacc50efba14c55fad9fc26365c768f3"
server_key_iv: "af0ea227d9c1fe83bcc091434916115a"
server_key_version: "encryptionkey@0"
I20260808 08:40:33.141527 24673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "b17adabc4f45475bb1c9a04ab578f3aa"
format_stamp: "Formatted at 2026-08-08 08:40:33 on dist-test-slave-39l8"
server_key: "eacc50efba14c55fad9fc26365c768f3"
server_key_iv: "af0ea227d9c1fe83bcc091434916115a"
server_key_version: "encryptionkey@0"
I20260808 08:40:33.147989 24673 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:40:33.152415 24695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:33.154065 24673 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:40:33.154311 24673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "b17adabc4f45475bb1c9a04ab578f3aa"
format_stamp: "Formatted at 2026-08-08 08:40:33 on dist-test-slave-39l8"
server_key: "eacc50efba14c55fad9fc26365c768f3"
server_key_iv: "af0ea227d9c1fe83bcc091434916115a"
server_key_version: "encryptionkey@0"
I20260808 08:40:33.154542 24673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:33.172286 24673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:33.177618 24673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:33.177948 24673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:33.198644 24673 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36853
I20260808 08:40:33.198678 24765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36853 every 8 connection(s)
I20260808 08:40:33.200371 24673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:33.204774 24767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:33.208031 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 24673
I20260808 08:40:33.208288 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:33.209009 20427 external_mini_cluster.cc:1428] Setting key c0e67ac5903eef7587b5e8494fed42d9
I20260808 08:40:33.220144 24767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa: Bootstrap starting.
I20260808 08:40:33.224198 24767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:33.225458 24767 log.cc:824] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:40:33 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:33.229199 24767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa: No bootstrap required, opened a new log
I20260808 08:40:33.238377 24771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:33.211385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44994 (local address 127.19.242.254:36853)
0808 08:40:33.212333 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:33.212352 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:33.212410 (+ 58us) server_negotiation.cc:407] Connection header received
0808 08:40:33.215166 (+ 2756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:33.215238 (+ 72us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:33.215928 (+ 690us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:33.216479 (+ 551us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:33.218211 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:33.220477 (+ 2266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:33.222095 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:33.223323 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:33.223591 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:33.228479 (+ 4888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:33.228494 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:33.228520 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:33.228569 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:33.232675 (+ 4106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:33.233771 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:33.233782 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:33.233792 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:33.234043 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:33.234594 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:33.234598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:33.234601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:33.235431 (+ 830us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:33.235869 (+ 438us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:33.236481 (+ 612us) server_negotiation.cc:299] Negotiation successful
0808 08:40:33.237063 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":393,"threads_started":1}
I20260808 08:40:33.239039 24767 raft_consensus.cc:348] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36853 } }
I20260808 08:40:33.239534 24767 raft_consensus.cc:374] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:33.239679 24767 raft_consensus.cc:729] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b17adabc4f45475bb1c9a04ab578f3aa, State: Initialized, Role: FOLLOWER
I20260808 08:40:33.240442 24767 consensus_queue.cc:260] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36853 } }
I20260808 08:40:33.240738 24767 raft_consensus.cc:388] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:33.240918 24767 raft_consensus.cc:482] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:33.241148 24767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:33.244351 24767 raft_consensus.cc:504] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36853 } }
I20260808 08:40:33.245124 24767 leader_election.cc:302] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b17adabc4f45475bb1c9a04ab578f3aa; no voters:
I20260808 08:40:33.245774 24767 leader_election.cc:288] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:33.245954 24774 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:33.246850 24774 raft_consensus.cc:686] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [term 1 LEADER]: Becoming Leader. State: Replica: b17adabc4f45475bb1c9a04ab578f3aa, State: Running, Role: LEADER
I20260808 08:40:33.247521 24774 consensus_queue.cc:237] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36853 } }
I20260808 08:40:33.248467 24767 sys_catalog.cc:564] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:33.251376 24777 sys_catalog.cc:455] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b17adabc4f45475bb1c9a04ab578f3aa. Latest consensus state: current_term: 1 leader_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36853 } } }
I20260808 08:40:33.251963 24777 sys_catalog.cc:458] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:33.251919 24776 sys_catalog.cc:455] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b17adabc4f45475bb1c9a04ab578f3aa" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36853 } } }
I20260808 08:40:33.252313 24776 sys_catalog.cc:458] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:33.254067 24788 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:33.259979 24788 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:33.271111 24788 catalog_manager.cc:1347] Generated new cluster ID: d981a5f57ecb4f238098ac865cb646e7
I20260808 08:40:33.271325 24788 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:33.284641 24788 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:33.286856 24788 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:33.298273 24788 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b17adabc4f45475bb1c9a04ab578f3aa: Generated new TSK 0
I20260808 08:40:33.299448 24788 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:33.383419 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36853
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:33.780346 24805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:33.780678 24805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:33.780776 24805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:33.788427 24805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:33.788578 24805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:33.788700 24805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:33.799253 24805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36853
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:33.800648 24805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:33.802047 24805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:33.816341 24812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:33.816385 24811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:33.816435 24815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:33.817818 24805 server_base.cc:1034] running on GCE node
I20260808 08:40:33.818569 24805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:33.819749 24805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:33.821035 24805 hybrid_clock.cc:648] HybridClock initialized: now 1786178433820978 us; error 47 us; skew 500 ppm
I20260808 08:40:33.821463 24805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:33 dist-test-slave-39l8 krb5kdc[24656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178433, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:33.825762 24805 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:33.827750 24805 webserver.cc:460] Webserver started at http://127.19.242.193:38871/ using document root <none> and password file <none>
I20260808 08:40:33.828583 24805 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:33.828760 24805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:33.829133 24805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:33.832837 24805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "51a445eade754ce281fa57a699acb899"
format_stamp: "Formatted at 2026-08-08 08:40:33 on dist-test-slave-39l8"
server_key: "badf33f94e6731e52fbdb7eed72c31ec"
server_key_iv: "378e967888ae2a5cecf1425b040a4a71"
server_key_version: "encryptionkey@0"
I20260808 08:40:33.833860 24805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "51a445eade754ce281fa57a699acb899"
format_stamp: "Formatted at 2026-08-08 08:40:33 on dist-test-slave-39l8"
server_key: "badf33f94e6731e52fbdb7eed72c31ec"
server_key_iv: "378e967888ae2a5cecf1425b040a4a71"
server_key_version: "encryptionkey@0"
I20260808 08:40:33.840509 24805 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 08:40:33.845058 24826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:33.846899 24805 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:33.847182 24805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "51a445eade754ce281fa57a699acb899"
format_stamp: "Formatted at 2026-08-08 08:40:33 on dist-test-slave-39l8"
server_key: "badf33f94e6731e52fbdb7eed72c31ec"
server_key_iv: "378e967888ae2a5cecf1425b040a4a71"
server_key_version: "encryptionkey@0"
I20260808 08:40:33.847479 24805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:33.866850 24805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:33.871937 24805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:33.872313 24805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:33.873485 24805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:33.875176 24805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:33.875288 24805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:33.875445 24805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:33.875519 24805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:33.912879 24805 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:45471
I20260808 08:40:33.912921 24990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:45471 every 8 connection(s)
I20260808 08:40:33.914443 24805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:33.915998 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 24805
I20260808 08:40:33.916266 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:33.917218 20427 external_mini_cluster.cc:1428] Setting key 90f519d3644d1bcf05979dc4fd061bc6
Aug 08 08:40:33 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178433, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:33.941613 24993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:33.920089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:51269 (local address 127.19.242.254:36853)
0808 08:40:33.920620 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:33.920627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:33.921934 (+ 1307us) server_negotiation.cc:407] Connection header received
0808 08:40:33.925136 (+ 3202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:33.925148 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:33.925234 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:33.925343 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:33.927899 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:33.928666 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:33.930453 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:33.930976 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:33.931127 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:33.935174 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:33.935179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:33.935182 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:33.935221 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:33.938111 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:33.939083 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:33.939088 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:33.939090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:33.939238 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:33.939711 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:33.939721 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:33.939723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:33.940017 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:33.940188 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:33.940956 (+ 768us) server_negotiation.cc:299] Negotiation successful
0808 08:40:33.941222 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":272,"threads_started":1}
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
I20260808 08:40:33.942765 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:33.920757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36853 (local address 127.19.242.193:51269)
0808 08:40:33.921718 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:33.921791 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:33.924699 (+ 2908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:33.925702 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:33.925718 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:33.926631 (+ 913us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:33.927624 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:33.927656 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:33.928873 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:33.928880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:33.930225 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:33.930241 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:33.931276 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:33.931285 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:33.931551 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:33.932426 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:33.932452 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:33.934875 (+ 2423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:33.938309 (+ 3434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:33.938321 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:33.938348 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:33.938926 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:33.939362 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:33.939367 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:33.939371 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:33.939580 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:33.940155 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:33.940165 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:33.940562 (+ 397us) client_negotiation.cc:769] Sending connection context
0808 08:40:33.940860 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 08:40:33.941445 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":361,"threads_started":1}
I20260808 08:40:33.944742 24991 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36853
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
I20260808 08:40:33.945174 24991 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:33.946089 24991 heartbeater.cc:511] Master 127.19.242.254:36853 requested a full tablet report, sending...
I20260808 08:40:33.949041 24720 ts_manager.cc:194] Registered new tserver with Master: 51a445eade754ce281fa57a699acb899 (127.19.242.193:45471)
I20260808 08:40:33.951468 24720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:51269
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:33.974990 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36853
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:34.351888 24997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:34.352278 24997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:34.352480 24997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:34.360399 24997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:34.360533 24997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:34.360649 24997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:34.370814 24997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36853
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:34.372233 24997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:34.373658 24997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:34.388444 25006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:34.388536 25003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:34.388512 25004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:34.390000 24997 server_base.cc:1034] running on GCE node
I20260808 08:40:34.390915 24997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:34.392045 24997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:34.393325 24997 hybrid_clock.cc:648] HybridClock initialized: now 1786178434393262 us; error 58 us; skew 500 ppm
I20260808 08:40:34.393764 24997 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:34 dist-test-slave-39l8 krb5kdc[24656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:34.397670 24997 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:34.399566 24997 webserver.cc:460] Webserver started at http://127.19.242.194:42843/ using document root <none> and password file <none>
I20260808 08:40:34.400369 24997 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:34.400532 24997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:34.400882 24997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:34.404187 24997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "d5f99db546d5461f8af639a15a6d57e8"
format_stamp: "Formatted at 2026-08-08 08:40:34 on dist-test-slave-39l8"
server_key: "7cb8ab0a92da571200764c4acfe91dd3"
server_key_iv: "5842d3a86bef08f13a477334895cdb01"
server_key_version: "encryptionkey@0"
I20260808 08:40:34.405045 24997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "d5f99db546d5461f8af639a15a6d57e8"
format_stamp: "Formatted at 2026-08-08 08:40:34 on dist-test-slave-39l8"
server_key: "7cb8ab0a92da571200764c4acfe91dd3"
server_key_iv: "5842d3a86bef08f13a477334895cdb01"
server_key_version: "encryptionkey@0"
I20260808 08:40:34.411351 24997 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:40:34.415515 25016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:34.417196 24997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:40:34.417433 24997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "d5f99db546d5461f8af639a15a6d57e8"
format_stamp: "Formatted at 2026-08-08 08:40:34 on dist-test-slave-39l8"
server_key: "7cb8ab0a92da571200764c4acfe91dd3"
server_key_iv: "5842d3a86bef08f13a477334895cdb01"
server_key_version: "encryptionkey@0"
I20260808 08:40:34.417732 24997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:34.431931 24997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:34.436599 24997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:34.436955 24997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:34.438089 24997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:34.439688 24997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:34.439810 24997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:34.439960 24997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:34.440032 24997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:34.477612 24997 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:33143
I20260808 08:40:34.477658 25161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:33143 every 8 connection(s)
I20260808 08:40:34.479148 24997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:34.482296 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 24997
I20260808 08:40:34.482517 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:34.483047 20427 external_mini_cluster.cc:1428] Setting key 56928120b8f07d382a5c6660e5c337f9
Aug 08 08:40:34 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:34.503403 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:34.482195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:42087 (local address 127.19.242.254:36853)
0808 08:40:34.482755 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:34.482762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:34.484109 (+ 1347us) server_negotiation.cc:407] Connection header received
0808 08:40:34.486159 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:34.486168 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:34.486265 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:34.486392 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:34.488203 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:34.489369 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:34.491329 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:34.491800 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:34.491953 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:34.496647 (+ 4694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:34.496653 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:34.496656 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:34.496698 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:34.499848 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:34.500789 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:34.500794 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:34.500796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:34.500947 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:34.501442 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:34.501446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:34.501448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:34.501741 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:34.501908 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:34.502689 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 08:40:34.502981 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":260,"threads_started":1}
I20260808 08:40:34.504602 25166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:34.482914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36853 (local address 127.19.242.194:42087)
0808 08:40:34.483937 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:34.483990 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:34.485826 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:34.486657 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:34.486666 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:34.487342 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:34.488000 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:34.488021 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:34.489579 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:34.489583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:34.491139 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:34.491157 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:34.492085 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:34.492095 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:34.492372 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:34.493145 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:34.493171 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:34.496330 (+ 3159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:34.500057 (+ 3727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:34.500070 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:34.500096 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:34.500616 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:34.501071 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:34.501077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:34.501080 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:34.501307 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:34.501881 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:34.501890 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:34.502294 (+ 404us) client_negotiation.cc:769] Sending connection context
0808 08:40:34.502582 (+ 288us) client_negotiation.cc:240] Negotiation successful
0808 08:40:34.503217 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":396,"threads_started":1}
I20260808 08:40:34.506470 25162 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36853
I20260808 08:40:34.506907 25162 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
I20260808 08:40:34.507769 25162 heartbeater.cc:511] Master 127.19.242.254:36853 requested a full tablet report, sending...
I20260808 08:40:34.509451 24720 ts_manager.cc:194] Registered new tserver with Master: d5f99db546d5461f8af639a15a6d57e8 (127.19.242.194:33143)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
I20260808 08:40:34.510478 24720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:42087
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:34.541865 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36853
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:34.908200 25172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:34.908526 25172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:34.908635 25172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:34.916719 25172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:34.916916 25172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:34.917107 25172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:34.928941 25172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36853
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:34.930490 25172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:34.932024 25172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:34.946803 25185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:34.946768 25179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:34.946910 25183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:34.948462 25172 server_base.cc:1034] running on GCE node
I20260808 08:40:34.949213 25172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:34.950398 25172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:34.951656 25172 hybrid_clock.cc:648] HybridClock initialized: now 1786178434951557 us; error 95 us; skew 500 ppm
I20260808 08:40:34.952035 25172 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:34 dist-test-slave-39l8 krb5kdc[24656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:34.955634 24991 heartbeater.cc:503] Master 127.19.242.254:36853 was elected leader, sending a full tablet report...
I20260808 08:40:34.956036 25172 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:34.957954 25172 webserver.cc:460] Webserver started at http://127.19.242.195:43533/ using document root <none> and password file <none>
I20260808 08:40:34.958889 25172 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:34.959055 25172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:34.959414 25172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:34.962905 25172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "e5110519748545b9b7db5d83e7b974fd"
format_stamp: "Formatted at 2026-08-08 08:40:34 on dist-test-slave-39l8"
server_key: "eb5d39f44e08dfea97ea397469c348a1"
server_key_iv: "b92339b920958f2676d5596e99133633"
server_key_version: "encryptionkey@0"
I20260808 08:40:34.963855 25172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "e5110519748545b9b7db5d83e7b974fd"
format_stamp: "Formatted at 2026-08-08 08:40:34 on dist-test-slave-39l8"
server_key: "eb5d39f44e08dfea97ea397469c348a1"
server_key_iv: "b92339b920958f2676d5596e99133633"
server_key_version: "encryptionkey@0"
I20260808 08:40:34.970160 25172 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:40:34.974330 25194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:34.976071 25172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:34.976328 25172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "e5110519748545b9b7db5d83e7b974fd"
format_stamp: "Formatted at 2026-08-08 08:40:34 on dist-test-slave-39l8"
server_key: "eb5d39f44e08dfea97ea397469c348a1"
server_key_iv: "b92339b920958f2676d5596e99133633"
server_key_version: "encryptionkey@0"
I20260808 08:40:34.976585 25172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:35.004892 25172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:35.010325 25172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:35.010671 25172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:35.011876 25172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:35.013484 25172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:35.013634 25172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:35.013828 25172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:35.013942 25172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:35.071350 25172 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:39631
I20260808 08:40:35.071450 25353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:39631 every 8 connection(s)
I20260808 08:40:35.073639 25172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:35.080863 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 25172
I20260808 08:40:35.081193 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:35.082249 20427 external_mini_cluster.cc:1428] Setting key c17713de6422f5c0bdc0135e43e9628b
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178434, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:35.112433 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:35.078072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:56007 (local address 127.19.242.254:36853)
0808 08:40:35.078924 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:35.078944 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:35.081086 (+ 2142us) server_negotiation.cc:407] Connection header received
0808 08:40:35.085657 (+ 4571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:35.085664 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:35.085859 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:35.086127 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:35.089623 (+ 3496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.090920 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.093749 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.094534 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.094818 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:35.101841 (+ 7023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:35.101848 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:35.101852 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:35.101912 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:35.106326 (+ 4414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.108058 (+ 1732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.108077 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.108079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.108313 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.109101 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.109110 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.109113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.109610 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:35.109926 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:35.111262 (+ 1336us) server_negotiation.cc:299] Negotiation successful
0808 08:40:35.111682 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":344,"threads_started":1}
I20260808 08:40:35.114092 25357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:35.079150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36853 (local address 127.19.242.195:56007)
0808 08:40:35.080712 (+ 1562us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:35.080837 (+ 125us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:35.085031 (+ 4194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:35.086662 (+ 1631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:35.086674 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:35.087884 (+ 1210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:35.089266 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:35.089303 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.091243 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.091250 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:35.093414 (+ 2164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:35.093454 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.095026 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.095084 (+ 58us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:35.095498 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:35.096750 (+ 1252us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:35.096798 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:35.101448 (+ 4650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:35.106828 (+ 5380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:35.106847 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:35.106879 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:35.107808 (+ 929us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:35.108524 (+ 716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:35.108539 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:35.108543 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:35.108891 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:35.109871 (+ 980us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:35.109894 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:35.110545 (+ 651us) client_negotiation.cc:769] Sending connection context
0808 08:40:35.111095 (+ 550us) client_negotiation.cc:240] Negotiation successful
0808 08:40:35.112176 (+ 1081us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":914,"thread_start_us":484,"threads_started":1}
I20260808 08:40:35.116509 25354 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36853
I20260808 08:40:35.117157 25354 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:35.118487 25354 heartbeater.cc:511] Master 127.19.242.254:36853 requested a full tablet report, sending...
I20260808 08:40:35.121451 24720 ts_manager.cc:194] Registered new tserver with Master: e5110519748545b9b7db5d83e7b974fd (127.19.242.195:39631)
I20260808 08:40:35.123081 24720 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:56007
I20260808 08:40:35.131881 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[24656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178435, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178435, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:35.230444 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:35.204341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45006 (local address 127.19.242.254:36853)
0808 08:40:35.204676 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:35.204683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:35.205674 (+ 991us) server_negotiation.cc:407] Connection header received
0808 08:40:35.205927 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:35.205943 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:35.206139 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:35.206381 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:35.208854 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.210073 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.212240 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.213344 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.213526 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:35.220397 (+ 6871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:35.220405 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:35.220417 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:35.220490 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:35.225468 (+ 4978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.227148 (+ 1680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.227155 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.227165 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.227395 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.228151 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.228155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.228157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.228793 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:35.229126 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:35.229720 (+ 594us) server_negotiation.cc:299] Negotiation successful
0808 08:40:35.230067 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260808 08:40:35.231590 24720 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45006
I20260808 08:40:35.234547 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24805
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178435, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:35.264372 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:35.236343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59648 (local address 127.19.242.193:45471)
0808 08:40:35.237328 (+ 985us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:35.237339 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:35.237380 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:40:35.237476 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:35.237492 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:35.237842 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:35.238069 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:35.240477 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.242149 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.244403 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.245443 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.245652 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:35.253580 (+ 7928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:35.253609 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:35.253636 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:35.253720 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:35.258914 (+ 5194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.260428 (+ 1514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.260445 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.260448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.260691 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.261398 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.261410 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.261420 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.262039 (+ 619us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:35.262596 (+ 557us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:35.263263 (+ 667us) server_negotiation.cc:299] Negotiation successful
0808 08:40:35.263807 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":473,"threads_started":1}
W20260808 08:40:35.266633 24986 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59648
W20260808 08:40:35.268961 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24805: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:35.269373 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 24805
I20260808 08:40:35.306787 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24997
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178435, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:35.336400 25374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:35.308342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42756 (local address 127.19.242.194:33143)
0808 08:40:35.309412 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:35.309423 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:35.309477 (+ 54us) server_negotiation.cc:407] Connection header received
0808 08:40:35.309580 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:35.309588 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:35.309951 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:35.310190 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:35.312724 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.314400 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.316694 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.317816 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.318195 (+ 379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:35.325886 (+ 7691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:35.325912 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:35.325940 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:35.326012 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:35.331068 (+ 5056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.332454 (+ 1386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.332472 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.332475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.332720 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.333430 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.333444 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.333446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.334032 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:35.334623 (+ 591us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:35.335285 (+ 662us) server_negotiation.cc:299] Negotiation successful
0808 08:40:35.335799 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":796,"thread_start_us":592,"threads_started":1}
W20260808 08:40:35.338542 25157 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42756
W20260808 08:40:35.340641 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24997: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:35.340927 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 24997
I20260808 08:40:35.379221 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 25172
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[24656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178435, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:35.412374 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:35.381919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41648 (local address 127.19.242.195:39631)
0808 08:40:35.383179 (+ 1260us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:35.383190 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:35.383278 (+ 88us) server_negotiation.cc:407] Connection header received
0808 08:40:35.383414 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:35.383429 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:35.383776 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:35.384164 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:35.387831 (+ 3667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.389937 (+ 2106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.393305 (+ 3368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:35.394570 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:35.395151 (+ 581us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:35.403825 (+ 8674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:35.403853 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:35.403887 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:35.403961 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:35.408267 (+ 4306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.409374 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.409391 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.409393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.409582 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:35.410093 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:35.410103 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:35.410105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:35.410574 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:35.411075 (+ 501us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:35.411543 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 08:40:35.411925 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1014,"thread_start_us":599,"threads_started":1}
W20260808 08:40:35.414152 25346 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41648
W20260808 08:40:35.415696 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 25172: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:40:35.415918 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 25172
I20260808 08:40:35.455250 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 24673
I20260808 08:40:35.457382 24758 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:35.613052 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 24673
2026-08-08T08:40:35Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4498 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[25381](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[25381](info): set up 2 sockets
Aug 08 08:40:35 dist-test-slave-39l8 krb5kdc[25381](info): commencing operation
krb5kdc: starting...
W20260808 08:40:37.184597 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.487s user 0.006s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:37 dist-test-slave-39l8 krb5kdc[25381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:37.449982 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37329
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:37329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:37.806807 25400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:37.807153 25400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:37.807252 25400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:37.814975 25400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:37.815102 25400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:37.815156 25400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:37.815207 25400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:37.815243 25400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:37.825464 25400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:37329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:37.826871 25400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:37.828230 25400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:37.841157 25411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:37.841249 25407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:37.841277 25408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:37.842464 25400 server_base.cc:1034] running on GCE node
I20260808 08:40:37.843499 25400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:37.845247 25400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:37.846521 25400 hybrid_clock.cc:648] HybridClock initialized: now 1786178437846472 us; error 64 us; skew 500 ppm
I20260808 08:40:37.846997 25400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:37 dist-test-slave-39l8 krb5kdc[25381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178437, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:37.850787 25400 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:37.852634 25400 webserver.cc:460] Webserver started at http://127.19.242.254:39101/ using document root <none> and password file <none>
I20260808 08:40:37.853437 25400 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:37.853591 25400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:37.853941 25400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:37.857381 25400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "1da373a8307c483e85ba122a9e13831d"
format_stamp: "Formatted at 2026-08-08 08:40:37 on dist-test-slave-39l8"
server_key: "445fd1add12d358ab1b1519b7a3e41be"
server_key_iv: "3f7c8232f71b1601d6f1552ed5aadeea"
server_key_version: "encryptionkey@0"
I20260808 08:40:37.858314 25400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "1da373a8307c483e85ba122a9e13831d"
format_stamp: "Formatted at 2026-08-08 08:40:37 on dist-test-slave-39l8"
server_key: "445fd1add12d358ab1b1519b7a3e41be"
server_key_iv: "3f7c8232f71b1601d6f1552ed5aadeea"
server_key_version: "encryptionkey@0"
I20260808 08:40:37.864284 25400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:40:37.868505 25422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:37.870200 25400 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:40:37.870537 25400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "1da373a8307c483e85ba122a9e13831d"
format_stamp: "Formatted at 2026-08-08 08:40:37 on dist-test-slave-39l8"
server_key: "445fd1add12d358ab1b1519b7a3e41be"
server_key_iv: "3f7c8232f71b1601d6f1552ed5aadeea"
server_key_version: "encryptionkey@0"
I20260808 08:40:37.870814 25400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:37.897065 25400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:37.902130 25400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:37.902469 25400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:37.923044 25400 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:37329
I20260808 08:40:37.923112 25496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:37329 every 8 connection(s)
I20260808 08:40:37.924584 25400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:37.927249 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 25400
I20260808 08:40:37.927536 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:37.928355 20427 external_mini_cluster.cc:1428] Setting key 6e75fb87fb071fa09b9b7bb150146b94
I20260808 08:40:37.929804 25498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:40:37 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:37.946843 25498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d: Bootstrap starting.
I20260808 08:40:37.950486 25498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:37.951790 25498 log.cc:824] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:37.954840 25501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:37.930780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51244 (local address 127.19.242.254:37329)
0808 08:40:37.931669 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:37.931682 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:37.931730 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:40:37.933470 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:37.933497 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:37.933950 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:37.934344 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:37.936551 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:37.938495 (+ 1944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:37.940431 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:37.941189 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:37.941347 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:37.946314 (+ 4967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:37.946323 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:37.946341 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:37.946391 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:37.949772 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:37.950614 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:37.950622 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:37.950654 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:37.950895 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:37.951358 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:37.951362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:37.951364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:37.951982 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:37.952302 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:37.952883 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 08:40:37.953402 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":418,"threads_started":1}
I20260808 08:40:37.955605 25498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d: No bootstrap required, opened a new log
I20260808 08:40:37.964123 25498 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da373a8307c483e85ba122a9e13831d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37329 } }
I20260808 08:40:37.964639 25498 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:37.964812 25498 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da373a8307c483e85ba122a9e13831d, State: Initialized, Role: FOLLOWER
I20260808 08:40:37.965518 25498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da373a8307c483e85ba122a9e13831d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37329 } }
I20260808 08:40:37.965786 25498 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:37.965948 25498 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:37.966130 25498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:37.968533 25498 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da373a8307c483e85ba122a9e13831d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37329 } }
I20260808 08:40:37.969105 25498 leader_election.cc:302] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1da373a8307c483e85ba122a9e13831d; no voters:
I20260808 08:40:37.969837 25498 leader_election.cc:288] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:37.970075 25505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:37.971446 25505 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [term 1 LEADER]: Becoming Leader. State: Replica: 1da373a8307c483e85ba122a9e13831d, State: Running, Role: LEADER
I20260808 08:40:37.972092 25505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da373a8307c483e85ba122a9e13831d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37329 } }
I20260808 08:40:37.972344 25498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:37.975567 25507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1da373a8307c483e85ba122a9e13831d. Latest consensus state: current_term: 1 leader_uuid: "1da373a8307c483e85ba122a9e13831d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da373a8307c483e85ba122a9e13831d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37329 } } }
I20260808 08:40:37.975708 25506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1da373a8307c483e85ba122a9e13831d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1da373a8307c483e85ba122a9e13831d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37329 } } }
I20260808 08:40:37.976065 25507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:37.976148 25506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:37.979533 25514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:37.984891 25514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:37.994381 25514 catalog_manager.cc:1347] Generated new cluster ID: d778b6740bad4774b6c90bbe5d0e47f5
I20260808 08:40:37.994544 25514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:38.009500 25514 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:38.011571 25514 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:38.021960 25514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1da373a8307c483e85ba122a9e13831d: Generated new TSK 0
I20260808 08:40:38.023305 25514 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:38.083498 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37329
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:38.460538 25530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:38.460889 25530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:38.460991 25530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:38.468341 25530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:38.468479 25530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:38.468600 25530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:38.480001 25530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:38.481344 25530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:38.482656 25530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:38.497238 25537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:38.497187 25543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:38.497216 25538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:38.497942 25530 server_base.cc:1034] running on GCE node
I20260808 08:40:38.498746 25530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:38.499863 25530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:38.501127 25530 hybrid_clock.cc:648] HybridClock initialized: now 1786178438501068 us; error 55 us; skew 500 ppm
I20260808 08:40:38.501468 25530 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:38 dist-test-slave-39l8 krb5kdc[25381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178438, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:38.507998 25530 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:38.509910 25530 webserver.cc:460] Webserver started at http://127.19.242.193:33475/ using document root <none> and password file <none>
I20260808 08:40:38.510810 25530 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:38.510973 25530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:38.511317 25530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:38.514614 25530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "7b7c8d784a4a4ce5a7b014fd6d307b3c"
format_stamp: "Formatted at 2026-08-08 08:40:38 on dist-test-slave-39l8"
server_key: "e16822aad4bdde1fa4ad3e06349324c7"
server_key_iv: "6ef93556d9eae9543f94c02da1a11577"
server_key_version: "encryptionkey@0"
I20260808 08:40:38.515630 25530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "7b7c8d784a4a4ce5a7b014fd6d307b3c"
format_stamp: "Formatted at 2026-08-08 08:40:38 on dist-test-slave-39l8"
server_key: "e16822aad4bdde1fa4ad3e06349324c7"
server_key_iv: "6ef93556d9eae9543f94c02da1a11577"
server_key_version: "encryptionkey@0"
I20260808 08:40:38.521715 25530 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:40:38.525933 25552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:38.528105 25530 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:38.528363 25530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "7b7c8d784a4a4ce5a7b014fd6d307b3c"
format_stamp: "Formatted at 2026-08-08 08:40:38 on dist-test-slave-39l8"
server_key: "e16822aad4bdde1fa4ad3e06349324c7"
server_key_iv: "6ef93556d9eae9543f94c02da1a11577"
server_key_version: "encryptionkey@0"
I20260808 08:40:38.528635 25530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:38.554081 25530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:38.559835 25530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:38.560199 25530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:38.561350 25530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:38.562944 25530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:38.563054 25530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:38.563213 25530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:38.563298 25530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:38.600943 25530 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:43513
I20260808 08:40:38.600986 25707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:43513 every 8 connection(s)
I20260808 08:40:38.602602 25530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:38.612267 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 25530
I20260808 08:40:38.612517 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:38.613318 20427 external_mini_cluster.cc:1428] Setting key cb420880fe97f4358e87142c1eb90eed
Aug 08 08:40:38 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178438, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:38.626111 25711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:38.605580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:37359 (local address 127.19.242.254:37329)
0808 08:40:38.606145 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:38.606150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:38.607376 (+ 1226us) server_negotiation.cc:407] Connection header received
0808 08:40:38.609475 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:38.609483 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:38.609605 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:38.609746 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:38.611662 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:38.612833 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:38.614852 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:38.615459 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:38.615620 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:38.619621 (+ 4001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:38.619627 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:38.619630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:38.619670 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:38.622429 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:38.623465 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:38.623470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:38.623472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:38.623609 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:38.624141 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:38.624145 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:38.624147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:38.624459 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:38.624633 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:38.625453 (+ 820us) server_negotiation.cc:299] Negotiation successful
0808 08:40:38.625729 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":281,"threads_started":1}
I20260808 08:40:38.627310 25712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:38.606216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37329 (local address 127.19.242.193:37359)
0808 08:40:38.607153 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:38.607202 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:38.609112 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:38.610043 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:38.610052 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:38.610798 (+ 746us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:38.611446 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:38.611466 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:38.613045 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:38.613050 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:38.614616 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:38.614633 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:38.615763 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:38.615772 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:38.616029 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:38.616808 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:38.616835 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:38.619293 (+ 2458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:38.622636 (+ 3343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:38.622648 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:38.622676 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:38.623291 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:38.623753 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:38.623759 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:38.623763 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:38.623991 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:38.624609 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:38.624618 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:38.625028 (+ 410us) client_negotiation.cc:769] Sending connection context
0808 08:40:38.625327 (+ 299us) client_negotiation.cc:240] Negotiation successful
0808 08:40:38.625958 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":321,"threads_started":1}
I20260808 08:40:38.629156 25708 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37329
I20260808 08:40:38.629536 25708 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:38.630628 25708 heartbeater.cc:511] Master 127.19.242.254:37329 requested a full tablet report, sending...
I20260808 08:40:38.633595 25445 ts_manager.cc:194] Registered new tserver with Master: 7b7c8d784a4a4ce5a7b014fd6d307b3c (127.19.242.193:43513)
I20260808 08:40:38.636021 25445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:37359
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:38.674120 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37329
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:39.035971 25718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:39.036304 25718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:39.036490 25718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:39.044269 25718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:39.044411 25718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:39.044597 25718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:39.054911 25718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:39.056339 25718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:39.057750 25718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:39.072194 25724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:39.071923 25725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:39.072250 25727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:39.078881 25718 server_base.cc:1034] running on GCE node
I20260808 08:40:39.079928 25718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:39.081152 25718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:39.082441 25718 hybrid_clock.cc:648] HybridClock initialized: now 1786178439082358 us; error 76 us; skew 500 ppm
I20260808 08:40:39.082880 25718 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:39 dist-test-slave-39l8 krb5kdc[25381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:39.086596 25718 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:39.088438 25718 webserver.cc:460] Webserver started at http://127.19.242.194:39225/ using document root <none> and password file <none>
I20260808 08:40:39.089282 25718 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:39.089449 25718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:39.089886 25718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:39.093533 25718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "e34888393eab4a45915d38685c5e8032"
format_stamp: "Formatted at 2026-08-08 08:40:39 on dist-test-slave-39l8"
server_key: "055001e8170a5e3109e9d543a5a93885"
server_key_iv: "ef883fbf68059bf4b219c17dd792f680"
server_key_version: "encryptionkey@0"
I20260808 08:40:39.094468 25718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "e34888393eab4a45915d38685c5e8032"
format_stamp: "Formatted at 2026-08-08 08:40:39 on dist-test-slave-39l8"
server_key: "055001e8170a5e3109e9d543a5a93885"
server_key_iv: "ef883fbf68059bf4b219c17dd792f680"
server_key_version: "encryptionkey@0"
I20260808 08:40:39.100697 25718 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260808 08:40:39.104791 25737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:39.106401 25718 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:40:39.106628 25718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "e34888393eab4a45915d38685c5e8032"
format_stamp: "Formatted at 2026-08-08 08:40:39 on dist-test-slave-39l8"
server_key: "055001e8170a5e3109e9d543a5a93885"
server_key_iv: "ef883fbf68059bf4b219c17dd792f680"
server_key_version: "encryptionkey@0"
I20260808 08:40:39.106947 25718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:39.124421 25718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:39.129458 25718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:39.129804 25718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:39.131034 25718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:39.132684 25718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:39.132799 25718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:39.132987 25718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:39.133064 25718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:39.170310 25718 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:42033
I20260808 08:40:39.170373 25909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:42033 every 8 connection(s)
I20260808 08:40:39.171813 25718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:39.182057 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 25718
I20260808 08:40:39.182353 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:39.182855 20427 external_mini_cluster.cc:1428] Setting key 2f7a2bc23d20741b23c3ff698f8312af
Aug 08 08:40:39 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:39.197592 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:39.174772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:56541 (local address 127.19.242.254:37329)
0808 08:40:39.175237 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:39.175242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:39.176447 (+ 1205us) server_negotiation.cc:407] Connection header received
0808 08:40:39.178455 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:39.178460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:39.178545 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:39.178648 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:39.180631 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.181403 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.183489 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.184122 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.184237 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:39.188781 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:39.188792 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:39.188800 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:39.188860 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:39.193340 (+ 4480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.194566 (+ 1226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.194575 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.194582 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.194833 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.195529 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.195537 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.195542 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.196022 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:39.196230 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:39.197070 (+ 840us) server_negotiation.cc:299] Negotiation successful
0808 08:40:39.197286 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":225,"threads_started":1}
I20260808 08:40:39.199265 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:39.175417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37329 (local address 127.19.242.194:56541)
0808 08:40:39.176272 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:39.176312 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:39.178127 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:39.179007 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:39.179016 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:39.179700 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:39.180423 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:39.180446 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.181635 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.181640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:39.183285 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:39.183302 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.184435 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.184444 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:39.184793 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:39.185835 (+ 1042us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:39.185862 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:39.188399 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:39.193618 (+ 5219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:39.193633 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:39.193658 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:39.194378 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:39.194978 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:39.194985 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:39.194991 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:39.195350 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:39.196178 (+ 828us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:39.196185 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:39.196604 (+ 419us) client_negotiation.cc:769] Sending connection context
0808 08:40:39.196927 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 08:40:39.197594 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":360,"threads_started":1}
I20260808 08:40:39.201102 25910 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37329
I20260808 08:40:39.201545 25910 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:39.202419 25910 heartbeater.cc:511] Master 127.19.242.254:37329 requested a full tablet report, sending...
I20260808 08:40:39.204327 25445 ts_manager.cc:194] Registered new tserver with Master: e34888393eab4a45915d38685c5e8032 (127.19.242.194:42033)
I20260808 08:40:39.205237 25445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:56541
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:39.242592 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37329
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:44789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:39.612515 25918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:39.612862 25918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:39.613073 25918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:39.621519 25918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:39.621683 25918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:39.621815 25918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:39.633479 25918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:39.635195 25918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:39.636672 25918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 08:40:39.640681 25708 heartbeater.cc:503] Master 127.19.242.254:37329 was elected leader, sending a full tablet report...
W20260808 08:40:39.652505 25928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:39.652612 25926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:39.652552 25925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:39.656550 25918 server_base.cc:1034] running on GCE node
I20260808 08:40:39.657363 25918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:39.658821 25918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:39.660104 25918 hybrid_clock.cc:648] HybridClock initialized: now 1786178439660039 us; error 67 us; skew 500 ppm
I20260808 08:40:39.660508 25918 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:39 dist-test-slave-39l8 krb5kdc[25381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:39.664250 25918 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:39.666122 25918 webserver.cc:460] Webserver started at http://127.19.242.195:44335/ using document root <none> and password file <none>
I20260808 08:40:39.667210 25918 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:39.667393 25918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:39.667778 25918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:39.671437 25918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "fdf53390c5ce4cdea0945bfb9b5310d4"
format_stamp: "Formatted at 2026-08-08 08:40:39 on dist-test-slave-39l8"
server_key: "8c62a4b81a72509fb7bf32aa2ad10c7a"
server_key_iv: "34e3ecff28ad33102ba6f7f4d7f1c3df"
server_key_version: "encryptionkey@0"
I20260808 08:40:39.672636 25918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "fdf53390c5ce4cdea0945bfb9b5310d4"
format_stamp: "Formatted at 2026-08-08 08:40:39 on dist-test-slave-39l8"
server_key: "8c62a4b81a72509fb7bf32aa2ad10c7a"
server_key_iv: "34e3ecff28ad33102ba6f7f4d7f1c3df"
server_key_version: "encryptionkey@0"
I20260808 08:40:39.679997 25918 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260808 08:40:39.684197 25936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:39.685854 25918 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:40:39.686096 25918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "fdf53390c5ce4cdea0945bfb9b5310d4"
format_stamp: "Formatted at 2026-08-08 08:40:39 on dist-test-slave-39l8"
server_key: "8c62a4b81a72509fb7bf32aa2ad10c7a"
server_key_iv: "34e3ecff28ad33102ba6f7f4d7f1c3df"
server_key_version: "encryptionkey@0"
I20260808 08:40:39.686404 25918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:39.706550 25918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:39.711676 25918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:39.712026 25918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:39.713233 25918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:39.714819 25918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:39.714926 25918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:39.715090 25918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:39.715171 25918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:39.751935 25918 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:43215
I20260808 08:40:39.752018 26086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:43215 every 8 connection(s)
I20260808 08:40:39.753412 25918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:39.760900 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 25918
I20260808 08:40:39.761214 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:39.761701 20427 external_mini_cluster.cc:1428] Setting key a6488e9230587ab59d95188000fb2650
Aug 08 08:40:39 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:39.776669 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:39.756376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:42633 (local address 127.19.242.254:37329)
0808 08:40:39.756874 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:39.756881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:39.758006 (+ 1125us) server_negotiation.cc:407] Connection header received
0808 08:40:39.760075 (+ 2069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:39.760081 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:39.760189 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:39.760309 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:39.762184 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.763275 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.764953 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.765393 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.765540 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:39.769464 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:39.769469 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:39.769473 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:39.769511 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:39.772685 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.773642 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.773649 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.773653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.773849 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.774415 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.774421 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.774425 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.774835 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:39.775026 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:39.775936 (+ 910us) server_negotiation.cc:299] Negotiation successful
0808 08:40:39.776222 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":212,"threads_started":1}
I20260808 08:40:39.778016 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:39.757030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37329 (local address 127.19.242.195:42633)
0808 08:40:39.757832 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:39.757872 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:39.759730 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:39.760545 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:39.760554 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:39.761225 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:39.761958 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:39.761979 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.763460 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.763464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:39.764790 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:39.764804 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.765661 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.765670 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:39.765923 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:39.766692 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:39.766781 (+ 89us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:39.769185 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:39.772891 (+ 3706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:39.772902 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:39.772928 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:39.773465 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:39.773990 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:39.773996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:39.774000 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:39.774273 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:39.774986 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:39.774996 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:39.775469 (+ 473us) client_negotiation.cc:769] Sending connection context
0808 08:40:39.775816 (+ 347us) client_negotiation.cc:240] Negotiation successful
0808 08:40:39.776489 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":307,"threads_started":1}
I20260808 08:40:39.779801 26087 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37329
I20260808 08:40:39.780179 26087 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:39.781075 26087 heartbeater.cc:511] Master 127.19.242.254:37329 requested a full tablet report, sending...
I20260808 08:40:39.782889 25445 ts_manager.cc:194] Registered new tserver with Master: fdf53390c5ce4cdea0945bfb9b5310d4 (127.19.242.195:43215)
I20260808 08:40:39.783761 25445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:42633
I20260808 08:40:39.791013 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:40:39 dist-test-slave-39l8 krb5kdc[25381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:40:39 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:39.856142 26098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:39.838603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54088 (local address 127.19.242.193:43513)
0808 08:40:39.839386 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:39.839404 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:39.839430 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:40:39.839500 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:39.839506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:39.839724 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:39.839933 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:39.841825 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.842935 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.844278 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.844914 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.845084 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:39.849620 (+ 4536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:39.849641 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:39.849658 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:39.849701 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:39.852863 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.853692 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.853701 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.853703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.853846 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.854307 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.854312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.854322 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.854779 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:39.855111 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:39.855459 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 08:40:39.855762 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":378,"threads_started":1}
Aug 08 08:40:39 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:39.877951 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:39.861634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51260 (local address 127.19.242.254:37329)
0808 08:40:39.861947 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:39.861954 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:39.862137 (+ 183us) server_negotiation.cc:407] Connection header received
0808 08:40:39.862315 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:39.862319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:39.862392 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:39.862483 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:39.864000 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.864785 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.866113 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.866618 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.866796 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:39.871530 (+ 4734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:39.871537 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:39.871540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:39.871588 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:39.874873 (+ 3285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.875816 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.875823 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.875825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.875983 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.876481 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.876485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.876487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.876870 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:39.877070 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:39.877376 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 08:40:39.877575 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
W20260808 08:40:39.878670 25445 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51260
I20260808 08:40:39.879995 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 25530
I20260808 08:40:39.895684 26098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:39.881056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54102 (local address 127.19.242.193:43513)
0808 08:40:39.881241 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:39.881246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:39.881520 (+ 274us) server_negotiation.cc:407] Connection header received
0808 08:40:39.881644 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:39.881649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:39.881760 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:39.881855 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:39.883314 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.884051 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.885361 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:39.885823 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:39.885944 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:39.888631 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:39.888636 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:39.888640 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:39.888683 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:39.892134 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.893196 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.893201 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.893203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.893404 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:39.893968 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:39.893974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:39.893979 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:39.894300 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:39.894587 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:39.895044 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 08:40:39.895343 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:40:39.896391 25702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:39.985810 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 25530
I20260808 08:40:40.015676 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 25718
Aug 08 08:40:40 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:40.038286 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:40.016806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53116 (local address 127.19.242.194:42033)
0808 08:40:40.017520 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:40.017530 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:40.017564 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:40:40.017665 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:40.017701 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:40.018044 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:40.018231 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:40.019962 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:40.022226 (+ 2264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:40.024367 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:40.025314 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:40.025467 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:40.031610 (+ 6143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:40.031629 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:40.031646 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:40.031721 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:40.035095 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:40.035979 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:40.035988 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:40.035991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:40.036133 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:40.036599 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:40.036605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:40.036607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:40.037016 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:40.037300 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:40.037715 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 08:40:40.037938 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":386,"threads_started":1}
I20260808 08:40:40.039779 25904 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:40.125008 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 25718
I20260808 08:40:40.146879 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 25918
Aug 08 08:40:40 dist-test-slave-39l8 krb5kdc[25381](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:40.165777 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:40.147978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46818 (local address 127.19.242.195:43215)
0808 08:40:40.148743 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:40.148751 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:40.148783 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:40:40.148850 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:40.148857 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:40.149072 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:40.149216 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:40.150610 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:40.151830 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:40.153266 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:40.153881 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:40.153995 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:40.159103 (+ 5108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:40.159128 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:40.159150 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:40.159208 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:40.162479 (+ 3271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:40.163469 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:40.163479 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:40.163481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:40.163664 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:40.164060 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:40.164064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:40.164066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:40.164457 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:40.164739 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:40.165088 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 08:40:40.165368 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":413,"threads_started":1}
I20260808 08:40:40.167359 26081 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:40.254040 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 25918
I20260808 08:40:40.279945 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 25400
I20260808 08:40:40.281213 25488 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:40.387818 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 25400
2026-08-08T08:40:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4750 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:40 dist-test-slave-39l8 krb5kdc[26119](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:40 dist-test-slave-39l8 krb5kdc[26119](info): set up 2 sockets
Aug 08 08:40:40 dist-test-slave-39l8 krb5kdc[26119](info): commencing operation
krb5kdc: starting...
W20260808 08:40:41.732306 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:41 dist-test-slave-39l8 krb5kdc[26119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:42.002905 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33619
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:33619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:42.375870 26137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:42.376250 26137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:42.376361 26137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:42.384979 26137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:42.385125 26137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:42.385176 26137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:42.385228 26137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:42.385269 26137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:42.396167 26137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:33619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:42.397609 26137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:42.399085 26137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:42.411613 26154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:42.411659 26156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:42.411554 26151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:42.413231 26137 server_base.cc:1034] running on GCE node
I20260808 08:40:42.414233 26137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:42.415963 26137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:42.417276 26137 hybrid_clock.cc:648] HybridClock initialized: now 1786178442417272 us; error 84 us; skew 500 ppm
I20260808 08:40:42.417743 26137 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:42 dist-test-slave-39l8 krb5kdc[26119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178442, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:42.421345 26137 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:42.422822 26137 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:42.422973 26137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:42.423352 26137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:42.426685 26137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "cd35dc00e0cd48d2aba6a7f0f079641b"
format_stamp: "Formatted at 2026-08-08 08:40:42 on dist-test-slave-39l8"
server_key: "43e8eddadcc6421e50809d1c1c4fb258"
server_key_iv: "20c939d21bc244bac5e88b673c24dfe7"
server_key_version: "encryptionkey@0"
I20260808 08:40:42.427737 26137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "cd35dc00e0cd48d2aba6a7f0f079641b"
format_stamp: "Formatted at 2026-08-08 08:40:42 on dist-test-slave-39l8"
server_key: "43e8eddadcc6421e50809d1c1c4fb258"
server_key_iv: "20c939d21bc244bac5e88b673c24dfe7"
server_key_version: "encryptionkey@0"
I20260808 08:40:42.434059 26137 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:40:42.438385 26163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:42.440210 26137 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:42.440462 26137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "cd35dc00e0cd48d2aba6a7f0f079641b"
format_stamp: "Formatted at 2026-08-08 08:40:42 on dist-test-slave-39l8"
server_key: "43e8eddadcc6421e50809d1c1c4fb258"
server_key_iv: "20c939d21bc244bac5e88b673c24dfe7"
server_key_version: "encryptionkey@0"
I20260808 08:40:42.440771 26137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:42.474287 26137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:42.479601 26137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:42.479867 26137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:42.500607 26137 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:33619
I20260808 08:40:42.500628 26239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:33619 every 8 connection(s)
I20260808 08:40:42.501658 26137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:42.503209 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 26137
I20260808 08:40:42.503456 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:42.504343 20427 external_mini_cluster.cc:1428] Setting key 69c2c7f0f6ec68347aaab73636659872
I20260808 08:40:42.507947 26240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:40:42 dist-test-slave-39l8 krb5kdc[26119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:42.520586 26240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b: Bootstrap starting.
I20260808 08:40:42.524588 26240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:42.525789 26240 log.cc:824] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:42.529728 26240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b: No bootstrap required, opened a new log
I20260808 08:40:42.530093 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:42.506885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.19.242.254:33619)
0808 08:40:42.507824 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:42.507838 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:42.507884 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:40:42.509675 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:42.509700 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:42.510144 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:42.510613 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:42.512468 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:42.513917 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:42.515409 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:42.516152 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:42.516393 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:42.521358 (+ 4965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:42.521370 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:42.521389 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:42.521442 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:42.524831 (+ 3389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:42.525716 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:42.525724 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:42.525734 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:42.525990 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:42.526573 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:42.526579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:42.526588 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:42.527325 (+ 737us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:42.527715 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:42.528143 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 08:40:42.528641 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":397,"threads_started":1}
I20260808 08:40:42.538197 26240 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33619 } }
I20260808 08:40:42.538617 26240 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:42.538698 26240 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd35dc00e0cd48d2aba6a7f0f079641b, State: Initialized, Role: FOLLOWER
I20260808 08:40:42.539458 26240 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33619 } }
I20260808 08:40:42.539827 26240 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:42.540010 26240 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:42.540242 26240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:42.542620 26240 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33619 } }
I20260808 08:40:42.543373 26240 leader_election.cc:302] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd35dc00e0cd48d2aba6a7f0f079641b; no voters:
I20260808 08:40:42.544121 26240 leader_election.cc:288] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:42.544297 26247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:42.545369 26247 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [term 1 LEADER]: Becoming Leader. State: Replica: cd35dc00e0cd48d2aba6a7f0f079641b, State: Running, Role: LEADER
I20260808 08:40:42.545953 26247 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33619 } }
I20260808 08:40:42.546533 26240 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:42.549117 26250 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd35dc00e0cd48d2aba6a7f0f079641b. Latest consensus state: current_term: 1 leader_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33619 } } }
I20260808 08:40:42.550557 26250 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:42.549862 26248 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd35dc00e0cd48d2aba6a7f0f079641b" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33619 } } }
I20260808 08:40:42.551275 26248 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:42.555783 26255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:42.561635 26255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:42.572728 26255 catalog_manager.cc:1347] Generated new cluster ID: ccaf3ff2639344dab9b73e4776914139
I20260808 08:40:42.572892 26255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:42.595433 26255 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:42.597484 26255 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:42.610342 26255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b: Generated new TSK 0
I20260808 08:40:42.611480 26255 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:42.685873 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33619
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:43.075798 26281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:43.076122 26281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:43.076295 26281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:43.083943 26281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:43.084080 26281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:43.084275 26281 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:43.094839 26281 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:43.096340 26281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:43.097788 26281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:43.112555 26295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:43.112650 26289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:43.112674 26293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:43.113823 26281 server_base.cc:1034] running on GCE node
I20260808 08:40:43.114588 26281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:43.115777 26281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:43.117045 26281 hybrid_clock.cc:648] HybridClock initialized: now 1786178443116969 us; error 79 us; skew 500 ppm
I20260808 08:40:43.117466 26281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:43 dist-test-slave-39l8 krb5kdc[26119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:43.121259 26281 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:43.122795 26281 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:43.122952 26281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:43.123332 26281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:43.126811 26281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "7db8cd72a93f4783a195004b5bda843f"
format_stamp: "Formatted at 2026-08-08 08:40:43 on dist-test-slave-39l8"
server_key: "7aa1145a348b88d19a7ddff9ebd86018"
server_key_iv: "d20e330a3699b2a6330ba910c5902464"
server_key_version: "encryptionkey@0"
I20260808 08:40:43.127786 26281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "7db8cd72a93f4783a195004b5bda843f"
format_stamp: "Formatted at 2026-08-08 08:40:43 on dist-test-slave-39l8"
server_key: "7aa1145a348b88d19a7ddff9ebd86018"
server_key_iv: "d20e330a3699b2a6330ba910c5902464"
server_key_version: "encryptionkey@0"
I20260808 08:40:43.133956 26281 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:40:43.138309 26304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:43.140146 26281 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:43.140400 26281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "7db8cd72a93f4783a195004b5bda843f"
format_stamp: "Formatted at 2026-08-08 08:40:43 on dist-test-slave-39l8"
server_key: "7aa1145a348b88d19a7ddff9ebd86018"
server_key_iv: "d20e330a3699b2a6330ba910c5902464"
server_key_version: "encryptionkey@0"
I20260808 08:40:43.140689 26281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:43.169744 26281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:43.175403 26281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:43.175745 26281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:43.176905 26281 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:43.178438 26281 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:43.178578 26281 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:43.178740 26281 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:43.178835 26281 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260808 08:40:43.216415 26281 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:44099
I20260808 08:40:43.216514 26468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:44099 every 8 connection(s)
I20260808 08:40:43.217392 26281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:43.218672 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 26281
I20260808 08:40:43.218989 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:43.219944 20427 external_mini_cluster.cc:1428] Setting key 508b3e701ea1a2fbb057f5d3c1f24a32
Aug 08 08:40:43 dist-test-slave-39l8 krb5kdc[26119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:43.241698 26471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:43.220800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:51903 (local address 127.19.242.254:33619)
0808 08:40:43.221313 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:43.221321 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:43.222767 (+ 1446us) server_negotiation.cc:407] Connection header received
0808 08:40:43.224449 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:43.224454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:43.224552 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:43.224679 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:43.226406 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.227214 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.228930 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.229352 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.229501 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:43.234312 (+ 4811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:43.234324 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:43.234327 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:43.234371 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:43.237379 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:43.238700 (+ 1321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:43.238765 (+ 65us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:43.238769 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:43.238929 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:43.239550 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:43.239555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:43.239558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:43.239939 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:43.240054 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:43.241215 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0808 08:40:43.241425 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":277,"threads_started":1}
I20260808 08:40:43.243522 26472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:43.221320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33619 (local address 127.19.242.193:51903)
0808 08:40:43.222217 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:43.222268 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:43.224129 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:43.224975 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:43.224985 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:43.225557 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:43.226184 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:43.226207 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.227401 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.227412 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:43.228730 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:43.228745 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.229621 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.229628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:43.229897 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:43.230820 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:43.230845 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:43.233876 (+ 3031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:43.237630 (+ 3754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:43.237647 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:43.237675 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:43.238515 (+ 840us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:43.239078 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:43.239086 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:43.239092 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:43.239403 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:43.240113 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:43.240125 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:43.240679 (+ 554us) client_negotiation.cc:769] Sending connection context
0808 08:40:43.241036 (+ 357us) client_negotiation.cc:240] Negotiation successful
0808 08:40:43.241786 (+ 750us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":398,"threads_started":1}
I20260808 08:40:43.245471 26469 heartbeater.cc:347] Connected to a master server at 127.19.242.254:33619
I20260808 08:40:43.245884 26469 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:43.246845 26469 heartbeater.cc:511] Master 127.19.242.254:33619 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
I20260808 08:40:43.249321 26190 ts_manager.cc:194] Registered new tserver with Master: 7db8cd72a93f4783a195004b5bda843f (127.19.242.193:44099)
I20260808 08:40:43.251025 26190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:51903
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:43.282621 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33619
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:43.651726 26477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:43.652077 26477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:43.652279 26477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:43.659931 26477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:43.660085 26477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:43.660300 26477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:43.670929 26477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:43.672469 26477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:43.673928 26477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:43.688328 26486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:43.688352 26495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:43.688519 26488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:43.692592 26477 server_base.cc:1034] running on GCE node
I20260808 08:40:43.693461 26477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:43.694653 26477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:43.696041 26477 hybrid_clock.cc:648] HybridClock initialized: now 1786178443695979 us; error 57 us; skew 500 ppm
I20260808 08:40:43.696431 26477 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:43 dist-test-slave-39l8 krb5kdc[26119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:43.703699 26477 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:43.705724 26477 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:43.705892 26477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:43.706327 26477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:43.710273 26477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "a800ec06d0814d108becd28fab0fac9d"
format_stamp: "Formatted at 2026-08-08 08:40:43 on dist-test-slave-39l8"
server_key: "46a9bf67314c183d184491916f2fdacd"
server_key_iv: "8c142894000e16177348cd8642b6df68"
server_key_version: "encryptionkey@0"
I20260808 08:40:43.711434 26477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "a800ec06d0814d108becd28fab0fac9d"
format_stamp: "Formatted at 2026-08-08 08:40:43 on dist-test-slave-39l8"
server_key: "46a9bf67314c183d184491916f2fdacd"
server_key_iv: "8c142894000e16177348cd8642b6df68"
server_key_version: "encryptionkey@0"
I20260808 08:40:43.718290 26477 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:40:43.722648 26501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:43.724526 26477 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:43.724759 26477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "a800ec06d0814d108becd28fab0fac9d"
format_stamp: "Formatted at 2026-08-08 08:40:43 on dist-test-slave-39l8"
server_key: "46a9bf67314c183d184491916f2fdacd"
server_key_iv: "8c142894000e16177348cd8642b6df68"
server_key_version: "encryptionkey@0"
I20260808 08:40:43.725024 26477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:43.750500 26477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:43.755895 26477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:43.756242 26477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:43.757447 26477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:43.759132 26477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:43.759235 26477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:43.759460 26477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:43.759553 26477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:43.797276 26477 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45441
I20260808 08:40:43.797399 26680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45441 every 8 connection(s)
I20260808 08:40:43.798295 26477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:43.803444 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 26477
I20260808 08:40:43.803717 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:43.804337 20427 external_mini_cluster.cc:1428] Setting key 6c83954d1b663217326ebbbb4505f0e7
Aug 08 08:40:43 dist-test-slave-39l8 krb5kdc[26119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178443, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:43.827206 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:43.801343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:37143 (local address 127.19.242.254:33619)
0808 08:40:43.801890 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:43.801898 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:43.803237 (+ 1339us) server_negotiation.cc:407] Connection header received
0808 08:40:43.806024 (+ 2787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:43.806030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:43.806123 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:43.806256 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:43.808749 (+ 2493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.809782 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.812724 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.813245 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.813366 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:43.818483 (+ 5117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:43.818493 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:43.818501 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:43.818556 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:43.822613 (+ 4057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:43.823832 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:43.823841 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:43.823847 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:43.824023 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:43.824726 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:43.824735 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:43.824741 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:43.825196 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:43.825398 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:43.826277 (+ 879us) server_negotiation.cc:299] Negotiation successful
0808 08:40:43.826574 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":271,"threads_started":1}
I20260808 08:40:43.828100 26687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:43.802023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33619 (local address 127.19.242.194:37143)
0808 08:40:43.802918 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:43.803012 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:43.805626 (+ 2614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:43.806538 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:43.806553 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:43.807470 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:43.808461 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:43.808496 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.809992 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.810011 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:43.812496 (+ 2485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:43.812520 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:43.813549 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:43.813559 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:43.813931 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:43.814843 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:43.814884 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:43.818111 (+ 3227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:43.822939 (+ 4828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:43.822950 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:43.822972 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:43.823643 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:43.824310 (+ 667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:43.824315 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:43.824317 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:43.824566 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:43.825369 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:43.825378 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:43.825810 (+ 432us) client_negotiation.cc:769] Sending connection context
0808 08:40:43.826094 (+ 284us) client_negotiation.cc:240] Negotiation successful
0808 08:40:43.826582 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":345,"threads_started":1}
I20260808 08:40:43.830173 26682 heartbeater.cc:347] Connected to a master server at 127.19.242.254:33619
I20260808 08:40:43.830567 26682 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:43.831427 26682 heartbeater.cc:511] Master 127.19.242.254:33619 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
I20260808 08:40:43.833297 26190 ts_manager.cc:194] Registered new tserver with Master: a800ec06d0814d108becd28fab0fac9d (127.19.242.194:45441)
I20260808 08:40:43.834211 26190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:37143
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:43.866438 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33619
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:44.240424 26694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:44.240764 26694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:44.240876 26694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:44.249254 26694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:44.249415 26694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:44.249616 26694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:44.254598 26469 heartbeater.cc:503] Master 127.19.242.254:33619 was elected leader, sending a full tablet report...
I20260808 08:40:44.263432 26694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33619
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:44.264914 26694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:44.266350 26694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:44.282487 26703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:44.282510 26704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:44.283077 26694 server_base.cc:1034] running on GCE node
W20260808 08:40:44.282630 26706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:44.284214 26694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:44.285538 26694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:44.286837 26694 hybrid_clock.cc:648] HybridClock initialized: now 1786178444286780 us; error 47 us; skew 500 ppm
I20260808 08:40:44.287214 26694 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:44 dist-test-slave-39l8 krb5kdc[26119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178444, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:44.291132 26694 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:44.292624 26694 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:44.292788 26694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:44.293179 26694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:44.296595 26694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "e265cbde0194474b9fc555da8fd15f57"
format_stamp: "Formatted at 2026-08-08 08:40:44 on dist-test-slave-39l8"
server_key: "f4a9c0858e363ce7425024240858aac2"
server_key_iv: "3dfb031ddbd96a9079427951bcf1effe"
server_key_version: "encryptionkey@0"
I20260808 08:40:44.297612 26694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "e265cbde0194474b9fc555da8fd15f57"
format_stamp: "Formatted at 2026-08-08 08:40:44 on dist-test-slave-39l8"
server_key: "f4a9c0858e363ce7425024240858aac2"
server_key_iv: "3dfb031ddbd96a9079427951bcf1effe"
server_key_version: "encryptionkey@0"
I20260808 08:40:44.303936 26694 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:40:44.308977 26714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:44.311161 26694 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:40:44.311429 26694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "e265cbde0194474b9fc555da8fd15f57"
format_stamp: "Formatted at 2026-08-08 08:40:44 on dist-test-slave-39l8"
server_key: "f4a9c0858e363ce7425024240858aac2"
server_key_iv: "3dfb031ddbd96a9079427951bcf1effe"
server_key_version: "encryptionkey@0"
I20260808 08:40:44.311748 26694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:44.327651 26694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:44.333654 26694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:44.334051 26694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:44.335381 26694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:44.337152 26694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:44.337328 26694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:44.337486 26694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:44.337584 26694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:44.378518 26694 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:45301
I20260808 08:40:44.378651 26873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:45301 every 8 connection(s)
I20260808 08:40:44.379649 26694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:44.385025 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 26694
I20260808 08:40:44.385315 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:44.385787 20427 external_mini_cluster.cc:1428] Setting key de83eaafa41c16cd687a0e0e227280e8
Aug 08 08:40:44 dist-test-slave-39l8 krb5kdc[26119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178444, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:44.405398 26878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.382840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:48129 (local address 127.19.242.254:33619)
0808 08:40:44.383469 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.383479 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.384169 (+ 690us) server_negotiation.cc:407] Connection header received
0808 08:40:44.386547 (+ 2378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.386553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.386664 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.386828 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:44.389201 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.390214 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.392314 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.392851 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.392985 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.397680 (+ 4695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:44.397686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:44.397691 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:44.397734 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:44.400971 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:44.402377 (+ 1406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:44.402384 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:44.402387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:44.402585 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:44.403360 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:44.403365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:44.403368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:44.403717 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:44.403861 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.404838 (+ 977us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.405077 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":318,"threads_started":1}
I20260808 08:40:44.406380 26879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.383049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33619 (local address 127.19.242.195:48129)
0808 08:40:44.383900 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:44.383949 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:44.386120 (+ 2171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:44.387186 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:44.387200 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:44.388098 (+ 898us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:44.388917 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.388939 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.390418 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.390423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.392025 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.392046 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.393214 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.393223 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.393493 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.394405 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:44.394437 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:44.397335 (+ 2898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:44.401271 (+ 3936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:44.401288 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:44.401313 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:44.402164 (+ 851us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:44.402812 (+ 648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:44.402821 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:44.402826 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:44.403213 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:44.403900 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:44.403908 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:44.404324 (+ 416us) client_negotiation.cc:769] Sending connection context
0808 08:40:44.404666 (+ 342us) client_negotiation.cc:240] Negotiation successful
0808 08:40:44.405128 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":347,"threads_started":1}
I20260808 08:40:44.408286 26876 heartbeater.cc:347] Connected to a master server at 127.19.242.254:33619
I20260808 08:40:44.408666 26876 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:44.409781 26876 heartbeater.cc:511] Master 127.19.242.254:33619 requested a full tablet report, sending...
I20260808 08:40:44.411868 26190 ts_manager.cc:194] Registered new tserver with Master: e265cbde0194474b9fc555da8fd15f57 (127.19.242.195:45301)
I20260808 08:40:44.412858 26190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:48129
I20260808 08:40:44.416406 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:40:44.437577 26878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.422018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46534 (local address 127.19.242.254:33619)
0808 08:40:44.422254 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.422260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.422779 (+ 519us) server_negotiation.cc:407] Connection header received
0808 08:40:44.423065 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.423070 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.423148 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.423259 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:44.425138 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.426032 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.427656 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.428079 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.428202 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.431132 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:44.431138 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:44.431142 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:44.431192 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:44.434123 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:44.435117 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:44.435123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:44.435126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:44.435345 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:44.435836 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:44.435840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:44.435843 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:44.436280 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:44.436505 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.437073 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.437317 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:40:44.442662 26190 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:44.450495 26190 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:44.485466 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.466017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:44099 (local address 127.0.0.1:35140)
0808 08:40:44.468060 (+ 2043us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:44.468121 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:44.468944 (+ 823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:44.471181 (+ 2237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:44.471195 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:44.471249 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:44.471815 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.471835 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.475018 (+ 3183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.475026 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.478814 (+ 3788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.478862 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.483830 (+ 4968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.483843 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.484200 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.484310 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 08:40:44.484522 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 08:40:44.484844 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1651,"thread_start_us":1460,"threads_started":1}
I20260808 08:40:44.488119 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.466262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35140 (local address 127.19.242.193:44099)
0808 08:40:44.467466 (+ 1204us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.467480 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.469304 (+ 1824us) server_negotiation.cc:407] Connection header received
0808 08:40:44.469461 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.469474 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.470016 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.470627 (+ 611us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:44.472137 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.474686 (+ 2549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.479601 (+ 4915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.482883 (+ 3282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.483300 (+ 417us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.483597 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.487230 (+ 3633us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.487565 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":997,"thread_start_us":756,"threads_started":1}
I20260808 08:40:44.494537 26377 tablet_service.cc:1467] Processing CreateTablet for tablet 314169a71fc24429892425e852663dd5 (DEFAULT_TABLE table=test-table [id=df2491a114ea48eaa7da8b0202a6249c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:44.496922 26377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314169a71fc24429892425e852663dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:44.502831 26899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.470748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:45301 (local address 127.0.0.1:40980)
0808 08:40:44.487430 (+ 16682us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:44.487464 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:44.487672 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:44.491949 (+ 4277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:44.491961 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:44.492033 (+ 72us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:44.493007 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.493038 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.496737 (+ 3699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.496745 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.499412 (+ 2667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.499438 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.501859 (+ 2421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.501868 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.502076 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.502113 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:40:44.502209 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 08:40:44.502370 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16466,"thread_start_us":17055,"threads_started":1}
I20260808 08:40:44.503720 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.469910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.19.242.195:45301)
0808 08:40:44.489844 (+ 19934us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.489859 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.489914 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:40:44.490074 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.490088 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.490803 (+ 715us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.491173 (+ 370us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:44.494258 (+ 3085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.496527 (+ 2269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.499611 (+ 3084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.501252 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.501484 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.501670 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.503125 (+ 1455us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.503341 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19613,"thread_start_us":21622,"threads_started":1}
I20260808 08:40:44.506804 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.467754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45441 (local address 127.0.0.1:57930)
0808 08:40:44.486633 (+ 18879us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:44.486665 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:44.486892 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:44.496794 (+ 9902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:44.496803 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:44.496850 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:44.497388 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.497414 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.499567 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.499573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.503290 (+ 3717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.503316 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.505891 (+ 2575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.505898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.506111 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.506150 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:40:44.506255 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 08:40:44.506434 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18715,"thread_start_us":26037,"threads_started":1}
I20260808 08:40:44.507912 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.467333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57930 (local address 127.19.242.194:45441)
0808 08:40:44.495522 (+ 28189us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.495534 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.495575 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:40:44.495695 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.495704 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.496062 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.496327 (+ 265us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:44.497625 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.499316 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.503585 (+ 4269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.505259 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.505472 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.505707 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.507215 (+ 1508us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.507473 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27856,"thread_start_us":27729,"threads_started":1}
I20260808 08:40:44.508946 26781 tablet_service.cc:1467] Processing CreateTablet for tablet 314169a71fc24429892425e852663dd5 (DEFAULT_TABLE table=test-table [id=df2491a114ea48eaa7da8b0202a6249c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:44.510509 26781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314169a71fc24429892425e852663dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:44.517143 26575 tablet_service.cc:1467] Processing CreateTablet for tablet 314169a71fc24429892425e852663dd5 (DEFAULT_TABLE table=test-table [id=df2491a114ea48eaa7da8b0202a6249c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:44.519061 26575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 314169a71fc24429892425e852663dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:44.528388 26901 tablet_bootstrap.cc:492] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Bootstrap starting.
I20260808 08:40:44.528738 26900 tablet_bootstrap.cc:492] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Bootstrap starting.
I20260808 08:40:44.533501 26901 tablet_bootstrap.cc:654] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:44.533696 26900 tablet_bootstrap.cc:654] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:44.535038 26900 log.cc:824] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:44.535979 26901 log.cc:824] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:44.539438 26904 tablet_bootstrap.cc:492] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Bootstrap starting.
I20260808 08:40:44.541479 26900 tablet_bootstrap.cc:492] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: No bootstrap required, opened a new log
I20260808 08:40:44.541481 26901 tablet_bootstrap.cc:492] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: No bootstrap required, opened a new log
I20260808 08:40:44.541836 26901 ts_tablet_manager.cc:1397] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.012s
I20260808 08:40:44.541829 26900 ts_tablet_manager.cc:1397] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260808 08:40:44.543277 26904 tablet_bootstrap.cc:654] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:44.544703 26904 log.cc:824] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:44.550127 26904 tablet_bootstrap.cc:492] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: No bootstrap required, opened a new log
I20260808 08:40:44.550527 26904 ts_tablet_manager.cc:1397] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 08:40:44.555245 26900 raft_consensus.cc:348] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.555173 26901 raft_consensus.cc:348] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.555810 26900 raft_consensus.cc:374] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:44.555822 26901 raft_consensus.cc:374] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:44.555945 26900 raft_consensus.cc:729] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db8cd72a93f4783a195004b5bda843f, State: Initialized, Role: FOLLOWER
I20260808 08:40:44.555945 26901 raft_consensus.cc:729] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e265cbde0194474b9fc555da8fd15f57, State: Initialized, Role: FOLLOWER
I20260808 08:40:44.556744 26901 consensus_queue.cc:260] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.556746 26900 consensus_queue.cc:260] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.558823 26876 heartbeater.cc:503] Master 127.19.242.254:33619 was elected leader, sending a full tablet report...
I20260808 08:40:44.559250 26900 ts_tablet_manager.cc:1428] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Time spent starting tablet: real 0.017s user 0.019s sys 0.000s
I20260808 08:40:44.559448 26901 ts_tablet_manager.cc:1428] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Time spent starting tablet: real 0.017s user 0.015s sys 0.003s
I20260808 08:40:44.560457 26904 raft_consensus.cc:348] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.561149 26904 raft_consensus.cc:374] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:44.561261 26904 raft_consensus.cc:729] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a800ec06d0814d108becd28fab0fac9d, State: Initialized, Role: FOLLOWER
I20260808 08:40:44.562629 26904 consensus_queue.cc:260] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.564018 26682 heartbeater.cc:503] Master 127.19.242.254:33619 was elected leader, sending a full tablet report...
I20260808 08:40:44.564944 26904 ts_tablet_manager.cc:1428] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
W20260808 08:40:44.631449 26877 tablet.cc:2369] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:40:44.720263 26470 tablet.cc:2369] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:40:44.768199 26909 raft_consensus.cc:482] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:44.768561 26909 raft_consensus.cc:504] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.770546 26909 leader_election.cc:288] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7db8cd72a93f4783a195004b5bda843f (127.19.242.193:44099), a800ec06d0814d108becd28fab0fac9d (127.19.242.194:45441)
I20260808 08:40:44.779263 26879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.771087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:44099 (local address 127.19.242.195:36995)
0808 08:40:44.771319 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:44.771342 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:44.771522 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:44.772064 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:44.772069 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:44.772102 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:44.772350 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.772364 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.773876 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.773881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.776200 (+ 2319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.776228 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.778203 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.778209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.778475 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.778514 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:40:44.778647 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 08:40:44.778861 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":27}
I20260808 08:40:44.779332 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.771104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:36995 (local address 127.19.242.193:44099)
0808 08:40:44.771318 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.771324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.771485 (+ 161us) server_negotiation.cc:407] Connection header received
0808 08:40:44.771770 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.771778 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.771869 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.772020 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:44.772521 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.773680 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.776456 (+ 2776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.777914 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.778176 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.778267 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.778787 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.778971 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:40:44.779332 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.771220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:55077 (local address 127.19.242.194:45441)
0808 08:40:44.771513 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.771520 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.772264 (+ 744us) server_negotiation.cc:407] Connection header received
0808 08:40:44.772408 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.772413 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.772525 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.772640 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:40:44.773161 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.774172 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.776735 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.778215 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.778393 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.778450 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.778908 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.779059 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260808 08:40:44.779320 26912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.771088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45441 (local address 127.19.242.195:55077)
0808 08:40:44.772123 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:44.772150 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:44.772290 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:44.772664 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:44.772667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:44.772689 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:40:44.772969 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.772976 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.774336 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.774342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.776533 (+ 2191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:44.776546 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.778463 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.778469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:44.778685 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.778755 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 08:40:44.778841 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 08:40:44.778952 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"mutex_wait_us":253,"thread_start_us":407,"threads_started":1}
I20260808 08:40:44.780689 26605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314169a71fc24429892425e852663dd5" candidate_uuid: "e265cbde0194474b9fc555da8fd15f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a800ec06d0814d108becd28fab0fac9d" is_pre_election: true
I20260808 08:40:44.780664 26405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314169a71fc24429892425e852663dd5" candidate_uuid: "e265cbde0194474b9fc555da8fd15f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db8cd72a93f4783a195004b5bda843f" is_pre_election: true
I20260808 08:40:44.781277 26605 raft_consensus.cc:2454] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e265cbde0194474b9fc555da8fd15f57 in term 0.
I20260808 08:40:44.781279 26405 raft_consensus.cc:2454] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e265cbde0194474b9fc555da8fd15f57 in term 0.
I20260808 08:40:44.782109 26718 leader_election.cc:302] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a800ec06d0814d108becd28fab0fac9d, e265cbde0194474b9fc555da8fd15f57; no voters:
I20260808 08:40:44.782582 26909 raft_consensus.cc:2781] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:44.782807 26909 raft_consensus.cc:482] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:44.782941 26909 raft_consensus.cc:3037] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:44.785458 26909 raft_consensus.cc:504] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.786237 26909 leader_election.cc:288] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [CANDIDATE]: Term 1 election: Requested vote from peers 7db8cd72a93f4783a195004b5bda843f (127.19.242.193:44099), a800ec06d0814d108becd28fab0fac9d (127.19.242.194:45441)
I20260808 08:40:44.786948 26405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314169a71fc24429892425e852663dd5" candidate_uuid: "e265cbde0194474b9fc555da8fd15f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db8cd72a93f4783a195004b5bda843f"
I20260808 08:40:44.787066 26605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "314169a71fc24429892425e852663dd5" candidate_uuid: "e265cbde0194474b9fc555da8fd15f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a800ec06d0814d108becd28fab0fac9d"
I20260808 08:40:44.787233 26405 raft_consensus.cc:3037] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:44.787341 26605 raft_consensus.cc:3037] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:44.789892 26605 raft_consensus.cc:2454] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e265cbde0194474b9fc555da8fd15f57 in term 1.
I20260808 08:40:44.789901 26405 raft_consensus.cc:2454] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e265cbde0194474b9fc555da8fd15f57 in term 1.
I20260808 08:40:44.790558 26718 leader_election.cc:302] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a800ec06d0814d108becd28fab0fac9d, e265cbde0194474b9fc555da8fd15f57; no voters:
I20260808 08:40:44.790982 26909 raft_consensus.cc:2781] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:44.791527 26909 raft_consensus.cc:686] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 1 LEADER]: Becoming Leader. State: Replica: e265cbde0194474b9fc555da8fd15f57, State: Running, Role: LEADER
I20260808 08:40:44.792201 26909 consensus_queue.cc:237] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } }
I20260808 08:40:44.797536 26190 catalog_manager.cc:5495] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to e265cbde0194474b9fc555da8fd15f57 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "e265cbde0194474b9fc555da8fd15f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e265cbde0194474b9fc555da8fd15f57" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 } health_report { overall_health: UNKNOWN } } }
W20260808 08:40:44.800731 26683 tablet.cc:2369] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:40:44.882570 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.876846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40990 (local address 127.19.242.195:45301)
0808 08:40:44.877025 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.877029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.877269 (+ 240us) server_negotiation.cc:407] Connection header received
0808 08:40:44.877473 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.877477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.877558 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.877716 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:40:44.878056 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.878812 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.880355 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.880780 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.880883 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.881456 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:40:44.882006 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:40:44.882185 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.882270 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.882347 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:40:44.891562 26605 raft_consensus.cc:1261] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 1 FOLLOWER]: Refusing update from remote peer e265cbde0194474b9fc555da8fd15f57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:44.891559 26405 raft_consensus.cc:1261] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 1 FOLLOWER]: Refusing update from remote peer e265cbde0194474b9fc555da8fd15f57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:44.892731 26915 consensus_queue.cc:1035] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a800ec06d0814d108becd28fab0fac9d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:44.893134 26909 consensus_queue.cc:1035] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7db8cd72a93f4783a195004b5bda843f" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:44.924819 26190 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:44.925160 26190 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:44.929459 26190 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd35dc00e0cd48d2aba6a7f0f079641b: Sending DeleteTablet for 3 replicas of tablet 314169a71fc24429892425e852663dd5
I20260808 08:40:44.931166 26575 tablet_service.cc:1514] Processing DeleteTablet for tablet 314169a71fc24429892425e852663dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:44 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:57930
I20260808 08:40:44.931205 26781 tablet_service.cc:1514] Processing DeleteTablet for tablet 314169a71fc24429892425e852663dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:44 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:40980
I20260808 08:40:44.931192 26377 tablet_service.cc:1514] Processing DeleteTablet for tablet 314169a71fc24429892425e852663dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:44 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:35140
I20260808 08:40:44.932125 26931 tablet_replica.cc:330] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: stopping tablet replica
I20260808 08:40:44.932649 26931 raft_consensus.cc:2229] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:44.933241 26931 raft_consensus.cc:2258] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:44.934816 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 26281
I20260808 08:40:44.937093 26931 ts_tablet_manager.cc:1905] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:44.948309 26931 ts_tablet_manager.cc:1918] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:44.948619 26931 log.cc:1196] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/314169a71fc24429892425e852663dd5
I20260808 08:40:44.949390 26931 ts_tablet_manager.cc:1939] T 314169a71fc24429892425e852663dd5 P a800ec06d0814d108becd28fab0fac9d: Deleting consensus metadata
I20260808 08:40:44.952153 26171 catalog_manager.cc:4841] TS a800ec06d0814d108becd28fab0fac9d (127.19.242.194:45441): tablet 314169a71fc24429892425e852663dd5 (table test-table [id=df2491a114ea48eaa7da8b0202a6249c]) successfully deleted
I20260808 08:40:44.953126 26933 tablet_replica.cc:330] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: stopping tablet replica
I20260808 08:40:44.953612 26933 raft_consensus.cc:2229] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:44.954279 26933 raft_consensus.cc:2258] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:44.955315 26932 tablet_replica.cc:330] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: stopping tablet replica
I20260808 08:40:44.955811 26932 raft_consensus.cc:2229] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:44.956368 26932 raft_consensus.cc:2258] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:44.956539 26933 ts_tablet_manager.cc:1905] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:44.958835 26932 ts_tablet_manager.cc:1905] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:40:44 dist-test-slave-39l8 krb5kdc[26119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:44.968261 26932 ts_tablet_manager.cc:1918] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:44.968614 26932 log.cc:1196] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/314169a71fc24429892425e852663dd5
I20260808 08:40:44.969352 26932 ts_tablet_manager.cc:1939] T 314169a71fc24429892425e852663dd5 P 7db8cd72a93f4783a195004b5bda843f: Deleting consensus metadata
I20260808 08:40:44.969573 26933 ts_tablet_manager.cc:1918] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:44.969795 26933 log.cc:1196] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/314169a71fc24429892425e852663dd5
I20260808 08:40:44.970433 26933 ts_tablet_manager.cc:1939] T 314169a71fc24429892425e852663dd5 P e265cbde0194474b9fc555da8fd15f57: Deleting consensus metadata
I20260808 08:40:44.971971 26165 catalog_manager.cc:4841] TS 7db8cd72a93f4783a195004b5bda843f (127.19.242.193:44099): tablet 314169a71fc24429892425e852663dd5 (table test-table [id=df2491a114ea48eaa7da8b0202a6249c]) successfully deleted
I20260808 08:40:44.972348 26165 catalog_manager.cc:4841] TS e265cbde0194474b9fc555da8fd15f57 (127.19.242.195:45301): tablet 314169a71fc24429892425e852663dd5 (table test-table [id=df2491a114ea48eaa7da8b0202a6249c]) successfully deleted
I20260808 08:40:44.973632 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:44.937507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35142 (local address 127.19.242.193:44099)
0808 08:40:44.937721 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:44.937728 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:44.952449 (+ 14721us) server_negotiation.cc:407] Connection header received
0808 08:40:44.952722 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:44.952728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:44.952838 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:44.952988 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:44.954358 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.955664 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.957665 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:44.958346 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:44.958472 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:44.964679 (+ 6207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:44.964703 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:44.964727 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:44.964789 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:44.969352 (+ 4563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:44.970538 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:44.970550 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:44.970554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:44.970803 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:44.971458 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:44.971464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:44.971468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:44.972024 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:44.972371 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:44.973101 (+ 730us) server_negotiation.cc:299] Negotiation successful
0808 08:40:44.973342 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:40:44.974395 26462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:45.067984 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 26281
I20260808 08:40:45.103778 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 26477
Aug 08 08:40:45 dist-test-slave-39l8 krb5kdc[26119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:45.122298 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:45.104784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57938 (local address 127.19.242.194:45441)
0808 08:40:45.104976 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:45.104984 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:45.105014 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:40:45.105321 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:45.105326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:45.105412 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:45.105533 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:45.107159 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:45.107925 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:45.109404 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:45.109847 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:45.110005 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:45.114962 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:45.114981 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:45.114999 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:45.115051 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:45.118865 (+ 3814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:45.119804 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:45.119815 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:45.119817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:45.119978 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:45.120451 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:45.120463 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:45.120466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:45.120922 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:45.121272 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:45.121649 (+ 377us) server_negotiation.cc:299] Negotiation successful
0808 08:40:45.121905 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:40:45.123239 26668 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:45.216183 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 26477
I20260808 08:40:45.251984 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 26694
Aug 08 08:40:45 dist-test-slave-39l8 krb5kdc[26119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:45.271664 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:45.253001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41006 (local address 127.19.242.195:45301)
0808 08:40:45.253207 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:45.253215 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:45.253237 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:40:45.253489 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:45.253494 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:45.253567 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:45.253729 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:45.255335 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:45.256212 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:45.257607 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:45.258117 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:45.258290 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:45.264144 (+ 5854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:45.264163 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:45.264181 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:45.264249 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:45.268074 (+ 3825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:45.269048 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:45.269058 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:45.269060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:45.269250 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:45.269737 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:45.269750 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:45.269752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:45.270167 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:45.270527 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:45.270944 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 08:40:45.271225 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:40:45.272574 26868 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:45.398618 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 26694
I20260808 08:40:45.432806 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 26137
I20260808 08:40:45.434242 26233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:45.546145 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 26137
2026-08-08T08:40:45Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (5158 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T08:40:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:45Z Disabled control of system clock
I20260808 08:40:45.640506 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:41555
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:43921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:41555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:40:46.002862 26948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:46.003273 26948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:46.003440 26948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:46.011382 26948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:46.011559 26948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:46.011605 26948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:46.011734 26948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:46.011811 26948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:46.024936 26948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:41555
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:41555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:46.026321 26948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:46.028390 26948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:46.041816 26954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:46.041853 26953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:46.042414 26956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:46.042848 26948 server_base.cc:1034] running on GCE node
I20260808 08:40:46.043689 26948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:46.045293 26948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:46.046562 26948 hybrid_clock.cc:648] HybridClock initialized: now 1786178446046492 us; error 71 us; skew 500 ppm
I20260808 08:40:46.047019 26948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:46.049731 26948 webserver.cc:460] Webserver started at http://127.19.242.254:36393/ using document root <none> and password file <none>
I20260808 08:40:46.050561 26948 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:46.050763 26948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:46.051190 26948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:46.054557 26948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "75a98d66fe1f46228173f5c619473065"
format_stamp: "Formatted at 2026-08-08 08:40:46 on dist-test-slave-39l8"
server_key: "4854bdec2dc4f59348c31174644ae351"
server_key_iv: "b383dc9854d740247ee3bf6781fd1821"
server_key_version: "encryptionkey@0"
I20260808 08:40:46.055639 26948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "75a98d66fe1f46228173f5c619473065"
format_stamp: "Formatted at 2026-08-08 08:40:46 on dist-test-slave-39l8"
server_key: "4854bdec2dc4f59348c31174644ae351"
server_key_iv: "b383dc9854d740247ee3bf6781fd1821"
server_key_version: "encryptionkey@0"
I20260808 08:40:46.061715 26948 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:40:46.066315 26966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:46.068061 26948 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 08:40:46.068323 26948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "75a98d66fe1f46228173f5c619473065"
format_stamp: "Formatted at 2026-08-08 08:40:46 on dist-test-slave-39l8"
server_key: "4854bdec2dc4f59348c31174644ae351"
server_key_iv: "b383dc9854d740247ee3bf6781fd1821"
server_key_version: "encryptionkey@0"
I20260808 08:40:46.068606 26948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:46.075876 26948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:46.076948 26948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:46.077315 26948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:46.097908 26948 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:41555
I20260808 08:40:46.097932 27032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:41555 every 8 connection(s)
I20260808 08:40:46.099521 26948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:46.103900 27033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:46.107574 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 26948
I20260808 08:40:46.107810 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:46.108484 20427 external_mini_cluster.cc:1428] Setting key 627e97c607eedfb962e93b5e4e60c97b
I20260808 08:40:46.117900 27033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065: Bootstrap starting.
I20260808 08:40:46.118161 27036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:46.110834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47064 (local address 127.19.242.254:41555)
0808 08:40:46.112129 (+ 1295us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:46.112141 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:46.112191 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:40:46.113850 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:46.113878 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:46.114455 (+ 577us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:46.114991 (+ 536us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:46.116244 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:46.116250 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:46.116263 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:46.116277 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:46.116339 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:46.116355 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:46.116611 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:46.116767 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 08:40:46.117058 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":415,"threads_started":1}
I20260808 08:40:46.121793 27033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:46.123107 27033 log.cc:824] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:46.126313 27033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065: No bootstrap required, opened a new log
I20260808 08:40:46.134692 27033 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75a98d66fe1f46228173f5c619473065" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 41555 } }
I20260808 08:40:46.135205 27033 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:46.135279 27033 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a98d66fe1f46228173f5c619473065, State: Initialized, Role: FOLLOWER
I20260808 08:40:46.135890 27033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75a98d66fe1f46228173f5c619473065" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 41555 } }
I20260808 08:40:46.136124 27033 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:46.136300 27033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:46.136504 27033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:46.138960 27033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75a98d66fe1f46228173f5c619473065" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 41555 } }
I20260808 08:40:46.139492 27033 leader_election.cc:302] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75a98d66fe1f46228173f5c619473065; no voters:
I20260808 08:40:46.140092 27033 leader_election.cc:288] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:46.140307 27039 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:46.141125 27039 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [term 1 LEADER]: Becoming Leader. State: Replica: 75a98d66fe1f46228173f5c619473065, State: Running, Role: LEADER
I20260808 08:40:46.141700 27039 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75a98d66fe1f46228173f5c619473065" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 41555 } }
I20260808 08:40:46.142488 27033 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:46.144974 27040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75a98d66fe1f46228173f5c619473065" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75a98d66fe1f46228173f5c619473065" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 41555 } } }
I20260808 08:40:46.145962 27040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:46.144979 27041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75a98d66fe1f46228173f5c619473065. Latest consensus state: current_term: 1 leader_uuid: "75a98d66fe1f46228173f5c619473065" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75a98d66fe1f46228173f5c619473065" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 41555 } } }
I20260808 08:40:46.146471 27041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065 [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:46.151628 27047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:46.157781 27047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:46.168401 27047 catalog_manager.cc:1347] Generated new cluster ID: 7a4a89c89f004088aac3695341640cf7
I20260808 08:40:46.168555 27047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:46.195220 27047 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:46.195705 27047 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:46.207366 27047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065: Generated new TSK 0
I20260808 08:40:46.208389 27047 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:40:46.221674 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:41555
--builtin_ntp_servers=127.19.242.212:43921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:40:46.587579 27060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:46.587924 27060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:46.588084 27060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:46.595885 27060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:46.596028 27060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:46.596191 27060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:46.605988 27060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:41555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:46.607612 27060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:46.609689 27060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:46.624513 27070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:46.624611 27071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:46.624876 27073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:46.625705 27060 server_base.cc:1034] running on GCE node
I20260808 08:40:46.626423 27060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:46.627571 27060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:46.628794 27060 hybrid_clock.cc:648] HybridClock initialized: now 1786178446628757 us; error 51 us; skew 500 ppm
I20260808 08:40:46.629185 27060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:46.631966 27060 webserver.cc:460] Webserver started at http://127.19.242.193:39873/ using document root <none> and password file <none>
I20260808 08:40:46.632809 27060 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:46.632933 27060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:46.633313 27060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:46.636514 27060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "78ae454b833f4d669e798198f6cff6a1"
format_stamp: "Formatted at 2026-08-08 08:40:46 on dist-test-slave-39l8"
server_key: "aa6be2488659cf379f928a0b458e018d"
server_key_iv: "44e60943312c48641dea95b70a29e947"
server_key_version: "encryptionkey@0"
I20260808 08:40:46.637585 27060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "78ae454b833f4d669e798198f6cff6a1"
format_stamp: "Formatted at 2026-08-08 08:40:46 on dist-test-slave-39l8"
server_key: "aa6be2488659cf379f928a0b458e018d"
server_key_iv: "44e60943312c48641dea95b70a29e947"
server_key_version: "encryptionkey@0"
I20260808 08:40:46.643651 27060 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:40:46.647675 27081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:46.649441 27060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:46.649655 27060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "78ae454b833f4d669e798198f6cff6a1"
format_stamp: "Formatted at 2026-08-08 08:40:46 on dist-test-slave-39l8"
server_key: "aa6be2488659cf379f928a0b458e018d"
server_key_iv: "44e60943312c48641dea95b70a29e947"
server_key_version: "encryptionkey@0"
I20260808 08:40:46.649919 27060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:46.657142 27060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:46.658197 27060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:46.658571 27060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:46.659782 27060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:46.661513 27060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:46.661671 27060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:46.661819 27060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:46.661926 27060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:46.700263 27060 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:43885
I20260808 08:40:46.700359 27243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:43885 every 8 connection(s)
I20260808 08:40:46.701725 27060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:46.710474 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 27060
I20260808 08:40:46.710752 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:46.711182 27247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:46.704585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:38119 (local address 127.19.242.254:41555)
0808 08:40:46.705094 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:46.705100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:46.706544 (+ 1444us) server_negotiation.cc:407] Connection header received
0808 08:40:46.708455 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:46.708459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:46.708542 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:46.708655 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:46.710259 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:46.710263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:46.710267 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:46.710286 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:46.710328 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:46.710340 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:46.710453 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:46.710793 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 08:40:46.710898 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":243,"threads_started":1}
I20260808 08:40:46.711607 20427 external_mini_cluster.cc:1428] Setting key 8041c862ac73e51db5b8a0216fa42ba7
I20260808 08:40:46.712635 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:46.705246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:41555 (local address 127.19.242.193:38119)
0808 08:40:46.706346 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:46.706385 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:46.708137 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:46.708899 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:46.708908 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:46.709010 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:46.709836 (+ 826us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:46.709839 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:46.709882 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:46.710040 (+ 158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:46.710458 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:46.710470 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:46.710478 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:40:46.710835 (+ 357us) client_negotiation.cc:240] Negotiation successful
0808 08:40:46.711162 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":294,"threads_started":1}
I20260808 08:40:46.714246 27245 heartbeater.cc:347] Connected to a master server at 127.19.242.254:41555
I20260808 08:40:46.714569 27245 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:46.714910 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:41555
--builtin_ntp_servers=127.19.242.212:43921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 08:40:46.715305 27245 heartbeater.cc:511] Master 127.19.242.254:41555 requested a full tablet report, sending...
I20260808 08:40:46.717664 26985 ts_manager.cc:194] Registered new tserver with Master: 78ae454b833f4d669e798198f6cff6a1 (127.19.242.193:43885)
W20260808 08:40:47.075350 27249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:47.075688 27249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:47.075841 27249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:47.083654 27249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:47.083786 27249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:47.083963 27249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:47.093892 27249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:41555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:47.095388 27249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:47.097534 27249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:47.114389 27257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:47.114650 27259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:47.115919 27261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:47.116493 27249 server_base.cc:1034] running on GCE node
I20260808 08:40:47.117193 27249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:47.118242 27249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:47.119495 27249 hybrid_clock.cc:648] HybridClock initialized: now 1786178447119426 us; error 62 us; skew 500 ppm
I20260808 08:40:47.119921 27249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:47.122527 27249 webserver.cc:460] Webserver started at http://127.19.242.194:44763/ using document root <none> and password file <none>
I20260808 08:40:47.123416 27249 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:47.123564 27249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:47.123934 27249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:47.127259 27249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc"
format_stamp: "Formatted at 2026-08-08 08:40:47 on dist-test-slave-39l8"
server_key: "3cec2dfc3c22a1f0b2d042b7b3db390f"
server_key_iv: "99eb7da7addd151c6c7391727e867fde"
server_key_version: "encryptionkey@0"
I20260808 08:40:47.128242 27249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc"
format_stamp: "Formatted at 2026-08-08 08:40:47 on dist-test-slave-39l8"
server_key: "3cec2dfc3c22a1f0b2d042b7b3db390f"
server_key_iv: "99eb7da7addd151c6c7391727e867fde"
server_key_version: "encryptionkey@0"
I20260808 08:40:47.134644 27249 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:40:47.138772 27268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:47.140354 27249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:47.140578 27249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc"
format_stamp: "Formatted at 2026-08-08 08:40:47 on dist-test-slave-39l8"
server_key: "3cec2dfc3c22a1f0b2d042b7b3db390f"
server_key_iv: "99eb7da7addd151c6c7391727e867fde"
server_key_version: "encryptionkey@0"
I20260808 08:40:47.140833 27249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:47.147565 27249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:47.148507 27249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:47.148823 27249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:47.149889 27249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:47.151551 27249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:47.151710 27249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:47.151823 27249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:47.151883 27249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:47.188853 27249 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:43301
I20260808 08:40:47.188915 27423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:43301 every 8 connection(s)
I20260808 08:40:47.190382 27249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:47.192988 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 27249
I20260808 08:40:47.193192 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:47.193835 20427 external_mini_cluster.cc:1428] Setting key 16c607d616088bda98fa689d99f11325
I20260808 08:40:47.197373 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:41555
--builtin_ntp_servers=127.19.242.212:43921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 08:40:47.200969 27247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.193458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:54255 (local address 127.19.242.254:41555)
0808 08:40:47.193647 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.193652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.195671 (+ 2019us) server_negotiation.cc:407] Connection header received
0808 08:40:47.198216 (+ 2545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.198221 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.198326 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.198422 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.200249 (+ 1827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.200254 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.200257 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.200276 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.200313 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.200327 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.200447 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.200684 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.200744 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:40:47.202530 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.194170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:41555 (local address 127.19.242.194:54255)
0808 08:40:47.195472 (+ 1302us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:47.195525 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:47.197841 (+ 2316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:47.198790 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:47.198806 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:47.198960 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:47.199811 (+ 851us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:47.199817 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:47.199891 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:47.200027 (+ 136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:47.200437 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:47.200450 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:47.200461 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:40:47.200792 (+ 331us) client_negotiation.cc:240] Negotiation successful
0808 08:40:47.201101 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":449,"threads_started":1}
I20260808 08:40:47.204283 27424 heartbeater.cc:347] Connected to a master server at 127.19.242.254:41555
I20260808 08:40:47.204628 27424 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:47.205291 27424 heartbeater.cc:511] Master 127.19.242.254:41555 requested a full tablet report, sending...
I20260808 08:40:47.206935 26985 ts_manager.cc:194] Registered new tserver with Master: 3cb1cfb36d2e45fd8e12f3312e4094dc (127.19.242.194:43301)
W20260808 08:40:47.562423 27427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:47.562860 27427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:47.563019 27427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:47.571305 27427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:47.571448 27427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:47.571568 27427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:47.581581 27427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:41555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:47.582976 27427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:47.584864 27427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:47.600620 27439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:47.600747 27436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:47.600666 27435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:47.602353 27427 server_base.cc:1034] running on GCE node
I20260808 08:40:47.603278 27427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:47.604399 27427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:47.605661 27427 hybrid_clock.cc:648] HybridClock initialized: now 1786178447605614 us; error 51 us; skew 500 ppm
I20260808 08:40:47.606047 27427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:47.608934 27427 webserver.cc:460] Webserver started at http://127.19.242.195:33495/ using document root <none> and password file <none>
I20260808 08:40:47.609797 27427 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:47.609952 27427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:47.610333 27427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:47.613644 27427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "2d3f8903200349a5af665d02f2be5995"
format_stamp: "Formatted at 2026-08-08 08:40:47 on dist-test-slave-39l8"
server_key: "1f40ce6c5c0a10b3f877c45f00e2b2d6"
server_key_iv: "9d92e734a88f59ce19015dff8bb7ecc0"
server_key_version: "encryptionkey@0"
I20260808 08:40:47.614630 27427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "2d3f8903200349a5af665d02f2be5995"
format_stamp: "Formatted at 2026-08-08 08:40:47 on dist-test-slave-39l8"
server_key: "1f40ce6c5c0a10b3f877c45f00e2b2d6"
server_key_iv: "9d92e734a88f59ce19015dff8bb7ecc0"
server_key_version: "encryptionkey@0"
I20260808 08:40:47.621416 27427 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:40:47.625808 27449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:47.627846 27427 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:40:47.628046 27427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "2d3f8903200349a5af665d02f2be5995"
format_stamp: "Formatted at 2026-08-08 08:40:47 on dist-test-slave-39l8"
server_key: "1f40ce6c5c0a10b3f877c45f00e2b2d6"
server_key_iv: "9d92e734a88f59ce19015dff8bb7ecc0"
server_key_version: "encryptionkey@0"
I20260808 08:40:47.628283 27427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:47.635113 27427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:47.636113 27427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:47.636439 27427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:47.637552 27427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:47.639480 27427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:47.639603 27427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:47.639775 27427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:47.639847 27427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:47.680601 27427 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:46073
I20260808 08:40:47.680645 27607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:46073 every 8 connection(s)
I20260808 08:40:47.682272 27427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:47.686933 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 27427
I20260808 08:40:47.687140 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:47.687690 20427 external_mini_cluster.cc:1428] Setting key 356ae44676203a99d25dee752ac898fc
I20260808 08:40:47.692555 27247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.685552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:45805 (local address 127.19.242.254:41555)
0808 08:40:47.685776 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.685781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.687431 (+ 1650us) server_negotiation.cc:407] Connection header received
0808 08:40:47.689645 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.689653 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.689723 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.689810 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.691579 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.691583 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.691586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.691605 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.691661 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.691674 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.691787 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.692270 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.692330 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 08:40:47.693712 27610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.686000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:41555 (local address 127.19.242.195:45805)
0808 08:40:47.687233 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:47.687301 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:47.689245 (+ 1944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:47.690231 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:47.690241 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:47.690363 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:47.691255 (+ 892us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:47.691257 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:47.691301 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:47.691402 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:47.691900 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:47.691909 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:47.691917 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:40:47.692370 (+ 453us) client_negotiation.cc:240] Negotiation successful
0808 08:40:47.692651 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":346,"threads_started":1}
I20260808 08:40:47.695333 27608 heartbeater.cc:347] Connected to a master server at 127.19.242.254:41555
I20260808 08:40:47.695675 27608 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:47.696339 27608 heartbeater.cc:511] Master 127.19.242.254:41555 requested a full tablet report, sending...
I20260808 08:40:47.697892 26985 ts_manager.cc:194] Registered new tserver with Master: 2d3f8903200349a5af665d02f2be5995 (127.19.242.195:46073)
I20260808 08:40:47.704193 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:40:47.712218 27247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.709212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47068 (local address 127.19.242.254:41555)
0808 08:40:47.709491 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.709500 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.709916 (+ 416us) server_negotiation.cc:407] Connection header received
0808 08:40:47.710161 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.710166 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.710225 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.710340 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.711481 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.711487 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.711492 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.711520 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.711556 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.711568 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.711724 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.711827 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.711898 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:40:47.721166 27245 heartbeater.cc:503] Master 127.19.242.254:41555 was elected leader, sending a full tablet report...
I20260808 08:40:47.717078 26985 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47068:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:40:47.724953 26985 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:40:47.748273 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.738829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43514 (local address 127.19.242.194:43301)
0808 08:40:47.744030 (+ 5201us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.744038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.744071 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:40:47.744154 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.744164 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.744458 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.746253 (+ 1795us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.747305 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.747316 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.747335 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.747356 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.747419 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.747444 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.747607 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.747772 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.747883 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5031,"thread_start_us":4896,"threads_started":1}
I20260808 08:40:47.748404 27628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.738651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:43301 (local address 127.0.0.1:43514)
0808 08:40:47.743279 (+ 4628us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:47.743334 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:47.743470 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:47.744706 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:47.744714 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:47.744811 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:47.745871 (+ 1060us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:47.745877 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:47.745914 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:47.746021 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:47.747544 (+ 1523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:47.747560 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:47.747572 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:40:47.747757 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 08:40:47.747860 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4340,"thread_start_us":5479,"threads_started":1}
I20260808 08:40:47.748867 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.739413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.19.242.195:46073)
0808 08:40:47.740198 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.740211 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.744572 (+ 4361us) server_negotiation.cc:407] Connection header received
0808 08:40:47.744872 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.744880 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.745133 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.745283 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.747700 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.747710 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.747737 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.747759 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.747822 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.747844 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.748026 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.748317 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.748428 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":409,"threads_started":1}
I20260808 08:40:47.749675 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.738773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:46073 (local address 127.0.0.1:60334)
0808 08:40:47.744422 (+ 5649us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:47.744444 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:47.744677 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:47.746654 (+ 1977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:47.746665 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:47.746684 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:47.747436 (+ 752us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:47.747441 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:47.747461 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:47.747510 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:47.748126 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:47.748132 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:47.748137 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:40:47.749206 (+ 1069us) client_negotiation.cc:240] Negotiation successful
0808 08:40:47.749270 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5510,"thread_start_us":4041,"threads_started":1}
I20260808 08:40:47.750406 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.744104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43310 (local address 127.19.242.193:43885)
0808 08:40:47.744784 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.744794 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.746384 (+ 1590us) server_negotiation.cc:407] Connection header received
0808 08:40:47.746626 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.746636 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.746887 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.747374 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.749328 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.749337 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.749351 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.749374 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.749437 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.749460 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.749609 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.749898 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.750013 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":499,"threads_started":1}
I20260808 08:40:47.751304 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.744566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43310)
0808 08:40:47.746260 (+ 1694us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:47.746280 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:47.746476 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:47.747071 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:47.747075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:47.747100 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:47.749041 (+ 1941us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:47.749044 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:47.749062 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:47.749113 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:47.749724 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:47.749729 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:47.749734 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:40:47.750678 (+ 944us) client_negotiation.cc:240] Negotiation successful
0808 08:40:47.750788 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1064,"thread_start_us":967,"threads_started":1}
I20260808 08:40:47.752583 27335 tablet_service.cc:1467] Processing CreateTablet for tablet 29f1fd6fded644f29be0dacd3052a57e (DEFAULT_TABLE table=test-table [id=da1097b238d64f5ca863b44254fa175b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:47.753118 27518 tablet_service.cc:1467] Processing CreateTablet for tablet 29f1fd6fded644f29be0dacd3052a57e (DEFAULT_TABLE table=test-table [id=da1097b238d64f5ca863b44254fa175b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:47.753983 27335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29f1fd6fded644f29be0dacd3052a57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:47.754498 27518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29f1fd6fded644f29be0dacd3052a57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:47.758972 27151 tablet_service.cc:1467] Processing CreateTablet for tablet 29f1fd6fded644f29be0dacd3052a57e (DEFAULT_TABLE table=test-table [id=da1097b238d64f5ca863b44254fa175b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:40:47.761299 27151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29f1fd6fded644f29be0dacd3052a57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:47.766783 27634 tablet_bootstrap.cc:492] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Bootstrap starting.
I20260808 08:40:47.769459 27635 tablet_bootstrap.cc:492] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Bootstrap starting.
I20260808 08:40:47.770977 27634 tablet_bootstrap.cc:654] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:47.772429 27634 log.cc:824] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:47.773815 27635 tablet_bootstrap.cc:654] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:47.775416 27635 log.cc:824] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:47.777751 27634 tablet_bootstrap.cc:492] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: No bootstrap required, opened a new log
I20260808 08:40:47.778174 27634 ts_tablet_manager.cc:1397] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260808 08:40:47.778520 27638 tablet_bootstrap.cc:492] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: Bootstrap starting.
I20260808 08:40:47.778920 27635 tablet_bootstrap.cc:492] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: No bootstrap required, opened a new log
I20260808 08:40:47.779242 27635 ts_tablet_manager.cc:1397] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260808 08:40:47.781594 27638 tablet_bootstrap.cc:654] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:47.783072 27638 log.cc:824] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:47.786314 27638 tablet_bootstrap.cc:492] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: No bootstrap required, opened a new log
I20260808 08:40:47.786652 27638 ts_tablet_manager.cc:1397] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260808 08:40:47.789695 27634 raft_consensus.cc:348] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.790280 27634 raft_consensus.cc:374] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:47.790453 27634 raft_consensus.cc:729] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3f8903200349a5af665d02f2be5995, State: Initialized, Role: FOLLOWER
I20260808 08:40:47.790254 27635 raft_consensus.cc:348] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.790760 27635 raft_consensus.cc:374] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:47.790934 27635 raft_consensus.cc:729] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb1cfb36d2e45fd8e12f3312e4094dc, State: Initialized, Role: FOLLOWER
I20260808 08:40:47.791265 27634 consensus_queue.cc:260] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.791551 27635 consensus_queue.cc:260] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.792627 27608 heartbeater.cc:503] Master 127.19.242.254:41555 was elected leader, sending a full tablet report...
I20260808 08:40:47.793494 27634 ts_tablet_manager.cc:1428] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260808 08:40:47.795938 27638 raft_consensus.cc:348] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.796355 27638 raft_consensus.cc:374] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:47.796463 27638 raft_consensus.cc:729] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78ae454b833f4d669e798198f6cff6a1, State: Initialized, Role: FOLLOWER
I20260808 08:40:47.797087 27638 consensus_queue.cc:260] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.799118 27638 ts_tablet_manager.cc:1428] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260808 08:40:47.800465 27424 heartbeater.cc:503] Master 127.19.242.254:41555 was elected leader, sending a full tablet report...
I20260808 08:40:47.801353 27635 ts_tablet_manager.cc:1428] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Time spent starting tablet: real 0.022s user 0.009s sys 0.011s
I20260808 08:40:47.824219 27644 raft_consensus.cc:482] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:40:47.824605 27644 raft_consensus.cc:504] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.826496 27644 leader_election.cc:288] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cb1cfb36d2e45fd8e12f3312e4094dc (127.19.242.194:43301), 2d3f8903200349a5af665d02f2be5995 (127.19.242.195:46073)
I20260808 08:40:47.830453 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.827043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:40689 (local address 127.19.242.195:46073)
0808 08:40:47.827346 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.827356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.828244 (+ 888us) server_negotiation.cc:407] Connection header received
0808 08:40:47.828494 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.828504 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.828557 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.828667 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.829761 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.829769 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.829776 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.829798 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.829837 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.829850 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.829995 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.830074 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.830148 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:40:47.830521 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.827022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:55631 (local address 127.19.242.194:43301)
0808 08:40:47.827360 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.827370 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.828263 (+ 893us) server_negotiation.cc:407] Connection header received
0808 08:40:47.828475 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.828485 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.828543 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.828653 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.829857 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.829862 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.829867 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.829887 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.829924 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.829935 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.830069 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.830152 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.830223 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260808 08:40:47.830991 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.826850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:46073 (local address 127.19.242.193:40689)
0808 08:40:47.828105 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:47.828126 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:47.828352 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:47.828690 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:47.828695 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:47.828719 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:47.829552 (+ 833us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:47.829554 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:47.829568 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:47.829611 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:47.829952 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:47.829957 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:47.829962 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:40:47.830122 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 08:40:47.830180 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1098,"spinlock_wait_cycles":61184,"thread_start_us":808,"threads_started":1}
I20260808 08:40:47.831025 27646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.826850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:43301 (local address 127.19.242.193:55631)
0808 08:40:47.828135 (+ 1285us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:47.828152 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:47.828326 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:47.828686 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:47.828691 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:47.828717 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:47.829646 (+ 929us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:40:47.829648 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:47.829661 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:40:47.829697 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:47.830033 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:47.830038 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:47.830042 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:40:47.830194 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 08:40:47.830250 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1172,"mutex_wait_us":47,"thread_start_us":723,"threads_started":1}
I20260808 08:40:47.832173 27547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29f1fd6fded644f29be0dacd3052a57e" candidate_uuid: "78ae454b833f4d669e798198f6cff6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3f8903200349a5af665d02f2be5995" is_pre_election: true
I20260808 08:40:47.832414 27368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29f1fd6fded644f29be0dacd3052a57e" candidate_uuid: "78ae454b833f4d669e798198f6cff6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" is_pre_election: true
I20260808 08:40:47.832788 27547 raft_consensus.cc:2454] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78ae454b833f4d669e798198f6cff6a1 in term 0.
I20260808 08:40:47.833011 27368 raft_consensus.cc:2454] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78ae454b833f4d669e798198f6cff6a1 in term 0.
I20260808 08:40:47.833601 27090 leader_election.cc:302] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3f8903200349a5af665d02f2be5995, 78ae454b833f4d669e798198f6cff6a1; no voters:
I20260808 08:40:47.834074 27644 raft_consensus.cc:2781] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:40:47.834260 27644 raft_consensus.cc:482] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:40:47.834385 27644 raft_consensus.cc:3037] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:47.836733 27644 raft_consensus.cc:504] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.837513 27644 leader_election.cc:288] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [CANDIDATE]: Term 1 election: Requested vote from peers 3cb1cfb36d2e45fd8e12f3312e4094dc (127.19.242.194:43301), 2d3f8903200349a5af665d02f2be5995 (127.19.242.195:46073)
I20260808 08:40:47.838124 27547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29f1fd6fded644f29be0dacd3052a57e" candidate_uuid: "78ae454b833f4d669e798198f6cff6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3f8903200349a5af665d02f2be5995"
I20260808 08:40:47.838125 27368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29f1fd6fded644f29be0dacd3052a57e" candidate_uuid: "78ae454b833f4d669e798198f6cff6a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc"
I20260808 08:40:47.838375 27547 raft_consensus.cc:3037] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:47.838374 27368 raft_consensus.cc:3037] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:47.841946 27547 raft_consensus.cc:2454] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78ae454b833f4d669e798198f6cff6a1 in term 1.
I20260808 08:40:47.841946 27368 raft_consensus.cc:2454] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78ae454b833f4d669e798198f6cff6a1 in term 1.
I20260808 08:40:47.842490 27090 leader_election.cc:302] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3f8903200349a5af665d02f2be5995, 78ae454b833f4d669e798198f6cff6a1; no voters:
I20260808 08:40:47.842892 27644 raft_consensus.cc:2781] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:47.843469 27644 raft_consensus.cc:686] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 1 LEADER]: Becoming Leader. State: Replica: 78ae454b833f4d669e798198f6cff6a1, State: Running, Role: LEADER
I20260808 08:40:47.844451 27644 consensus_queue.cc:237] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } }
I20260808 08:40:47.849613 26985 catalog_manager.cc:5495] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78ae454b833f4d669e798198f6cff6a1 (127.19.242.193). New cstate: current_term: 1 leader_uuid: "78ae454b833f4d669e798198f6cff6a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78ae454b833f4d669e798198f6cff6a1" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 43885 } health_report { overall_health: HEALTHY } } }
I20260808 08:40:47.880468 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.878161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43314 (local address 127.19.242.193:43885)
0808 08:40:47.878344 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.878349 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.878370 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:40:47.878537 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.878541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.878631 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.878798 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.879846 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.879851 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.879854 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.879873 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.879908 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.879920 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.880054 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.880210 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.880266 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:40:47.890575 27547 raft_consensus.cc:1261] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 1 FOLLOWER]: Refusing update from remote peer 78ae454b833f4d669e798198f6cff6a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:47.891510 27368 raft_consensus.cc:1261] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 1 FOLLOWER]: Refusing update from remote peer 78ae454b833f4d669e798198f6cff6a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:40:47.891750 27650 consensus_queue.cc:1035] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3f8903200349a5af665d02f2be5995" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:47.892490 27644 consensus_queue.cc:1035] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cb1cfb36d2e45fd8e12f3312e4094dc" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:40:47.903115 27655 mvcc.cc:205] Tried to move back new op lower bound from 7316186922547412992 to 7316186922375925760. Current Snapshot: MvccSnapshot[applied={T|T < 7316186922547412992}]
I20260808 08:40:47.912879 27657 mvcc.cc:205] Tried to move back new op lower bound from 7316186922547412992 to 7316186922375925760. Current Snapshot: MvccSnapshot[applied={T|T < 7316186922547412992}]
I20260808 08:40:47.922088 26987 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:47.922422 26987 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47068:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:40:47.926694 26987 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75a98d66fe1f46228173f5c619473065: Sending DeleteTablet for 3 replicas of tablet 29f1fd6fded644f29be0dacd3052a57e
I20260808 08:40:47.928148 27335 tablet_service.cc:1514] Processing DeleteTablet for tablet 29f1fd6fded644f29be0dacd3052a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:47 UTC) from {username='slave'} at 127.0.0.1:43514
I20260808 08:40:47.928354 27151 tablet_service.cc:1514] Processing DeleteTablet for tablet 29f1fd6fded644f29be0dacd3052a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:47 UTC) from {username='slave'} at 127.0.0.1:43310
I20260808 08:40:47.928363 27518 tablet_service.cc:1514] Processing DeleteTablet for tablet 29f1fd6fded644f29be0dacd3052a57e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:40:47 UTC) from {username='slave'} at 127.0.0.1:60334
I20260808 08:40:47.931519 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 27060
I20260808 08:40:47.943708 27670 tablet_replica.cc:330] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: stopping tablet replica
I20260808 08:40:47.944507 27670 raft_consensus.cc:2229] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:40:47.945474 27670 raft_consensus.cc:2258] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:47.947456 27668 tablet_replica.cc:330] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: stopping tablet replica
I20260808 08:40:47.948055 27668 raft_consensus.cc:2229] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:47.948700 27668 raft_consensus.cc:2258] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:47.949425 27670 ts_tablet_manager.cc:1905] T 29f1fd6fded644f29be0dacd3052a57e P 78ae454b833f4d669e798198f6cff6a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:47.950963 27668 ts_tablet_manager.cc:1905] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:47.952359 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:47.933759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43320 (local address 127.19.242.193:43885)
0808 08:40:47.934527 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:47.934537 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:47.946596 (+ 12059us) server_negotiation.cc:407] Connection header received
0808 08:40:47.946871 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:47.946876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:47.946945 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:47.947063 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:47.951339 (+ 4276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:47.951346 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:47.951351 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:47.951385 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:47.951427 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:47.951445 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:47.951577 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:47.951930 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 08:40:47.952029 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:40:47.953899 27239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:47.954043 27672 tablet_replica.cc:330] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: stopping tablet replica
I20260808 08:40:47.954735 27672 raft_consensus.cc:2229] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:40:47.955466 27672 raft_consensus.cc:2258] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:40:47.958163 27672 ts_tablet_manager.cc:1905] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:40:47.959044 27668 ts_tablet_manager.cc:1918] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:47.959257 27668 log.cc:1196] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/29f1fd6fded644f29be0dacd3052a57e
I20260808 08:40:47.959824 27668 ts_tablet_manager.cc:1939] T 29f1fd6fded644f29be0dacd3052a57e P 3cb1cfb36d2e45fd8e12f3312e4094dc: Deleting consensus metadata
I20260808 08:40:47.961935 26970 catalog_manager.cc:4841] TS 3cb1cfb36d2e45fd8e12f3312e4094dc (127.19.242.194:43301): tablet 29f1fd6fded644f29be0dacd3052a57e (table test-table [id=da1097b238d64f5ca863b44254fa175b]) successfully deleted
I20260808 08:40:47.964464 27672 ts_tablet_manager.cc:1918] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:40:47.964687 27672 log.cc:1196] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/29f1fd6fded644f29be0dacd3052a57e
I20260808 08:40:47.965178 27672 ts_tablet_manager.cc:1939] T 29f1fd6fded644f29be0dacd3052a57e P 2d3f8903200349a5af665d02f2be5995: Deleting consensus metadata
I20260808 08:40:47.966897 26971 catalog_manager.cc:4841] TS 2d3f8903200349a5af665d02f2be5995 (127.19.242.195:46073): tablet 29f1fd6fded644f29be0dacd3052a57e (table test-table [id=da1097b238d64f5ca863b44254fa175b]) successfully deleted
I20260808 08:40:48.061236 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 27060
I20260808 08:40:48.084427 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 27249
W20260808 08:40:48.084265 26971 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.242.193:43885 (error 108)
I20260808 08:40:48.086467 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.085913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43332)
0808 08:40:48.086108 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:48.086328 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 08:40:48.086789 26971 catalog_manager.cc:4584] TS 78ae454b833f4d669e798198f6cff6a1 (127.19.242.193:43885): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 29f1fd6fded644f29be0dacd3052a57e: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
I20260808 08:40:48.088336 27629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.085331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43526 (local address 127.19.242.194:43301)
0808 08:40:48.085503 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:48.085512 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:48.085568 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:40:48.085829 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:48.085833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:48.085927 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:48.086062 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:48.087646 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:48.087650 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:48.087654 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:48.087672 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:48.087706 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:48.087720 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:48.087891 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:48.087989 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 08:40:48.088056 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:40:48.089052 27416 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:48.140713 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.140082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43344)
0808 08:40:48.140367 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:48.140487 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260808 08:40:48.142079 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.141643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43358)
0808 08:40:48.141824 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:48.141930 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:40:48.181394 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 27249
I20260808 08:40:48.203197 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.202549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43370)
0808 08:40:48.202895 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:48.203018 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 08:40:48.204339 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.203962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43380)
0808 08:40:48.204131 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:48.204213 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 08:40:48.211144 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 27427
I20260808 08:40:48.214668 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.212101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60342 (local address 127.19.242.195:46073)
0808 08:40:48.212356 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:48.212362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:48.212386 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:40:48.212641 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:48.212646 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:48.212735 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:48.212862 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:48.213835 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:48.213840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:48.213844 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:48.213860 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:48.213896 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:48.213911 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:48.214067 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:48.214265 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 08:40:48.214336 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:40:48.215613 27602 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:48.285432 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.284804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43390)
0808 08:40:48.285112 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:48.285266 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260808 08:40:48.286787 27627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:48.286227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:43885 (local address 127.0.0.1:43400)
0808 08:40:48.286484 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:48.286570 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260808 08:40:48.312203 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 27427
I20260808 08:40:48.338429 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 26948
I20260808 08:40:48.339813 27026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:48.448458 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 26948
2026-08-08T08:40:48Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2899 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 08:40:48.499930 20427 mini_oidc.cc:152] Starting JWKS server
I20260808 08:40:48.503095 20427 webserver.cc:460] Webserver started at https://127.0.0.1:45191/ using document root <none> and password file <none>
I20260808 08:40:48.503517 20427 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:40:48.504295 20427 webserver.cc:460] Webserver started at http://127.0.0.1:41329/ using document root <none> and password file <none>
2026-08-08T08:40:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:48Z Disabled control of system clock
I20260808 08:40:48.544515 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43021
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:43021
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45191/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/testchainca.cert with env {}
W20260808 08:40:48.906576 27688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:48.907042 27688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:48.907213 27688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:48.915727 27688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:48.915902 27688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:48.915992 27688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:48.916108 27688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:48.916188 27688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:40:48.916280 27688 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:40:48.916357 27688 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45191/jwks.json
I20260808 08:40:48.927670 27688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:43021
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45191/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:48.929212 27688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:48.930807 27688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:48.944301 27694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:48.944375 27697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:48.944424 27695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:48.945652 27688 server_base.cc:1034] running on GCE node
I20260808 08:40:48.946843 27688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:48.948662 27688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:48.949966 27688 hybrid_clock.cc:648] HybridClock initialized: now 1786178448949911 us; error 46 us; skew 500 ppm
I20260808 08:40:48.950562 27688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:48.957369 27688 webserver.cc:460] Webserver started at http://127.19.242.254:43657/ using document root <none> and password file <none>
I20260808 08:40:48.958249 27688 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:48.958415 27688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:48.958828 27688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:48.962232 27688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "4012779e0772466db1aff981bec51e6a"
format_stamp: "Formatted at 2026-08-08 08:40:48 on dist-test-slave-39l8"
server_key: "ddf44c21249903674697dff4db43e946"
server_key_iv: "a2564745248dfe071782e06d2a640acd"
server_key_version: "encryptionkey@0"
I20260808 08:40:48.963220 27688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "4012779e0772466db1aff981bec51e6a"
format_stamp: "Formatted at 2026-08-08 08:40:48 on dist-test-slave-39l8"
server_key: "ddf44c21249903674697dff4db43e946"
server_key_iv: "a2564745248dfe071782e06d2a640acd"
server_key_version: "encryptionkey@0"
I20260808 08:40:48.969177 27688 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:40:48.973333 27708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:48.975025 27688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:40:48.975298 27688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "4012779e0772466db1aff981bec51e6a"
format_stamp: "Formatted at 2026-08-08 08:40:48 on dist-test-slave-39l8"
server_key: "ddf44c21249903674697dff4db43e946"
server_key_iv: "a2564745248dfe071782e06d2a640acd"
server_key_version: "encryptionkey@0"
I20260808 08:40:48.975557 27688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:49.004375 27688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:49.005280 27688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:49.005568 27688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:49.025207 27688 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:43021
I20260808 08:40:49.025231 27791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:43021 every 8 connection(s)
I20260808 08:40:49.026873 27688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:49.031438 27792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:49.032420 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 27688
I20260808 08:40:49.032693 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:49.033567 20427 external_mini_cluster.cc:1428] Setting key f7de660b0eb3294d6cbdf5def169c36c
I20260808 08:40:49.045692 27792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a: Bootstrap starting.
I20260808 08:40:49.048309 27795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:49.035882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57194 (local address 127.19.242.254:43021)
0808 08:40:49.036994 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:49.037014 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:49.037065 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:40:49.038909 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:49.038939 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:49.039498 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:49.039956 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:49.040611 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.041936 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.043474 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.044203 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.044431 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:49.045765 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:49.045774 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:49.045790 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:49.046416 (+ 626us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:49.046506 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:49.046532 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:49.046669 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:49.046968 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 08:40:49.047309 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":365,"threads_started":1}
I20260808 08:40:49.049367 27792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:49.050540 27792 log.cc:824] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:49.052779 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:40:49.054008 27792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a: No bootstrap required, opened a new log
I20260808 08:40:49.062501 27792 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4012779e0772466db1aff981bec51e6a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43021 } }
I20260808 08:40:49.063089 27792 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:49.063254 27792 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4012779e0772466db1aff981bec51e6a, State: Initialized, Role: FOLLOWER
I20260808 08:40:49.063979 27792 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4012779e0772466db1aff981bec51e6a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43021 } }
I20260808 08:40:49.064215 27792 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:49.064319 27792 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:49.064463 27792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:49.066694 27792 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4012779e0772466db1aff981bec51e6a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43021 } }
I20260808 08:40:49.067368 27792 leader_election.cc:302] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4012779e0772466db1aff981bec51e6a; no voters:
I20260808 08:40:49.067938 27792 leader_election.cc:288] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:49.068193 27797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:49.069520 27797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [term 1 LEADER]: Becoming Leader. State: Replica: 4012779e0772466db1aff981bec51e6a, State: Running, Role: LEADER
I20260808 08:40:49.070147 27797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4012779e0772466db1aff981bec51e6a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43021 } }
I20260808 08:40:49.070488 27792 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:49.073158 27798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4012779e0772466db1aff981bec51e6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4012779e0772466db1aff981bec51e6a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43021 } } }
I20260808 08:40:49.073594 27798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:49.074203 27799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4012779e0772466db1aff981bec51e6a. Latest consensus state: current_term: 1 leader_uuid: "4012779e0772466db1aff981bec51e6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4012779e0772466db1aff981bec51e6a" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43021 } } }
I20260808 08:40:49.074504 27799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:49.076233 27804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:49.082299 27804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:49.093145 27804 catalog_manager.cc:1347] Generated new cluster ID: 8107b8d3d29448b0a9c2ad35e13d97b9
I20260808 08:40:49.093336 27804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:49.103971 27804 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:49.105571 27804 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:49.120394 27804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4012779e0772466db1aff981bec51e6a: Generated new TSK 0
I20260808 08:40:49.121474 27804 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:40:49.165134 27831 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 08:40:49.165493 27831 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:40:49.166692 27795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:49.142470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57208 (local address 127.19.242.254:43021)
0808 08:40:49.142760 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:49.142768 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:49.143317 (+ 549us) server_negotiation.cc:407] Connection header received
0808 08:40:49.143702 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:49.143710 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:49.143826 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:49.144010 (+ 184us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:40:49.144632 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.145840 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.147501 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.148235 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.148384 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:49.149003 (+ 619us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:40:49.165914 (+ 16911us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45191/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:40:49.166361 (+ 447us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57208: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45191/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":84}
W20260808 08:40:49.166878 27795 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57208: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45191/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 08:40:49.168428 27830 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:49.142314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:43021 (local address 127.0.0.1:57208)
0808 08:40:49.143148 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:49.143170 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:49.143395 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:49.144044 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:49.144048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:49.144060 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:40:49.144439 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:49.144448 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.146018 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.146023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:49.147329 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:49.147344 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.148447 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.148452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:49.148586 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:49.148667 (+ 81us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:40:49.166285 (+ 17618us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45191/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:40:49.166590 (+ 305us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.242.254:43021: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45191/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":458,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.19.242.254:43021: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45191/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 08:40:49.170496 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 27688
I20260808 08:40:49.172037 27782 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:49.268198 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 27688
2026-08-08T08:40:49Z chronyd exiting
I20260808 08:40:49.330595 20427 test_util.cc:175] -----------------------------------------------
I20260808 08:40:49.330900 20427 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178398071314-20427-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (836 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 08:40:49.335456 20427 mini_oidc.cc:152] Starting JWKS server
I20260808 08:40:49.337589 20427 webserver.cc:460] Webserver started at https://127.0.0.1:40253/ using document root <none> and password file <none>
I20260808 08:40:49.337905 20427 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:40:49.338847 20427 webserver.cc:460] Webserver started at http://127.0.0.1:36975/ using document root <none> and password file <none>
2026-08-08T08:40:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:49Z Disabled control of system clock
I20260808 08:40:49.379472 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46577
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:34699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:46577
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40253/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/testchainca.cert with env {}
W20260808 08:40:49.747082 27838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:49.747484 27838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:49.747646 27838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:49.755558 27838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:49.755733 27838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:49.755836 27838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:49.755959 27838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:49.756043 27838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:40:49.756140 27838 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:40:49.756219 27838 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40253/jwks.json
I20260808 08:40:49.767043 27838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:46577
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40253/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:49.768569 27838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:49.770037 27838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:49.783543 27845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:49.783600 27847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:49.783881 27849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:49.785006 27838 server_base.cc:1034] running on GCE node
I20260808 08:40:49.786085 27838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:49.787813 27838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:49.789074 27838 hybrid_clock.cc:648] HybridClock initialized: now 1786178449789020 us; error 80 us; skew 500 ppm
I20260808 08:40:49.789479 27838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:49.792457 27838 webserver.cc:460] Webserver started at http://127.19.242.254:36583/ using document root <none> and password file <none>
I20260808 08:40:49.793293 27838 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:49.793459 27838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:49.793843 27838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:49.797257 27838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "e10a5e2838ee45fdb56e21761e204154"
format_stamp: "Formatted at 2026-08-08 08:40:49 on dist-test-slave-39l8"
server_key: "a77b5df5aa300c7c12366329bbacdb0c"
server_key_iv: "16934b1c78b122dd39192fe880f90ee4"
server_key_version: "encryptionkey@0"
I20260808 08:40:49.798187 27838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "e10a5e2838ee45fdb56e21761e204154"
format_stamp: "Formatted at 2026-08-08 08:40:49 on dist-test-slave-39l8"
server_key: "a77b5df5aa300c7c12366329bbacdb0c"
server_key_iv: "16934b1c78b122dd39192fe880f90ee4"
server_key_version: "encryptionkey@0"
I20260808 08:40:49.804543 27838 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 08:40:49.809038 27856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:49.810927 27838 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:49.811177 27838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "e10a5e2838ee45fdb56e21761e204154"
format_stamp: "Formatted at 2026-08-08 08:40:49 on dist-test-slave-39l8"
server_key: "a77b5df5aa300c7c12366329bbacdb0c"
server_key_iv: "16934b1c78b122dd39192fe880f90ee4"
server_key_version: "encryptionkey@0"
I20260808 08:40:49.811483 27838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:49.831099 27838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:49.832350 27838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:49.832763 27838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:49.853423 27838 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:46577
I20260808 08:40:49.853441 27932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:46577 every 8 connection(s)
I20260808 08:40:49.854981 27838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:49.857488 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 27838
I20260808 08:40:49.857694 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:49.858414 20427 external_mini_cluster.cc:1428] Setting key 8d5177df801a2656381c49039186f126
I20260808 08:40:49.859369 27935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:49.875695 27935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154: Bootstrap starting.
I20260808 08:40:49.876042 27938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:49.860639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.19.242.254:46577)
0808 08:40:49.861782 (+ 1143us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:49.861798 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:49.861854 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:40:49.864449 (+ 2595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:49.864487 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:49.865210 (+ 723us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:49.865739 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:49.866378 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.868502 (+ 2124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.869936 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.871095 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.871314 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:49.872669 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:49.872681 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:49.872712 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:49.873566 (+ 854us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:49.873687 (+ 121us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:49.873718 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:49.873849 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:49.874154 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 08:40:49.874552 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":383,"threads_started":1}
I20260808 08:40:49.879537 27935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:49.880764 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:40:49.880931 27935 log.cc:824] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:49.884337 27935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154: No bootstrap required, opened a new log
I20260808 08:40:49.892558 27935 raft_consensus.cc:348] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10a5e2838ee45fdb56e21761e204154" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46577 } }
I20260808 08:40:49.893065 27935 raft_consensus.cc:374] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:49.893198 27935 raft_consensus.cc:729] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10a5e2838ee45fdb56e21761e204154, State: Initialized, Role: FOLLOWER
I20260808 08:40:49.893872 27935 consensus_queue.cc:260] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10a5e2838ee45fdb56e21761e204154" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46577 } }
I20260808 08:40:49.894169 27935 raft_consensus.cc:388] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:49.894346 27935 raft_consensus.cc:482] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:49.894538 27935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:49.897404 27935 raft_consensus.cc:504] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10a5e2838ee45fdb56e21761e204154" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46577 } }
I20260808 08:40:49.897956 27935 leader_election.cc:302] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e10a5e2838ee45fdb56e21761e204154; no voters:
I20260808 08:40:49.898553 27935 leader_election.cc:288] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:49.898756 27941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:49.899551 27941 raft_consensus.cc:686] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [term 1 LEADER]: Becoming Leader. State: Replica: e10a5e2838ee45fdb56e21761e204154, State: Running, Role: LEADER
I20260808 08:40:49.900105 27941 consensus_queue.cc:237] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10a5e2838ee45fdb56e21761e204154" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46577 } }
I20260808 08:40:49.900902 27935 sys_catalog.cc:564] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:49.903460 27942 sys_catalog.cc:455] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e10a5e2838ee45fdb56e21761e204154" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10a5e2838ee45fdb56e21761e204154" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46577 } } }
I20260808 08:40:49.903327 27943 sys_catalog.cc:455] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e10a5e2838ee45fdb56e21761e204154. Latest consensus state: current_term: 1 leader_uuid: "e10a5e2838ee45fdb56e21761e204154" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10a5e2838ee45fdb56e21761e204154" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46577 } } }
I20260808 08:40:49.904704 27942 sys_catalog.cc:458] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:49.904729 27943 sys_catalog.cc:458] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154 [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:49.906800 27956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:49.912442 27956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:49.923193 27956 catalog_manager.cc:1347] Generated new cluster ID: eb98c04d9b8b416aa643449312d9b4af
I20260808 08:40:49.923358 27956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:49.950459 27956 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:49.952534 27956 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:49.965018 27956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e10a5e2838ee45fdb56e21761e204154: Generated new TSK 0
I20260808 08:40:49.966295 27956 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:40:50.011535 27976 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 08:40:50.011701 27976 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260808 08:40:50.017344 27975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:49.991900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:46577 (local address 127.0.0.1:36528)
0808 08:40:49.992619 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:49.992636 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:49.992838 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:49.993399 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:49.993404 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:49.993418 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:40:49.993747 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:49.993757 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.994974 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.994979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:49.996109 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:49.996123 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.996997 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.997004 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:49.997186 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:49.997229 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:40:50.016201 (+ 18972us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:40:50.016716 (+ 515us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.242.254:46577: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":401,"threads_started":1}
I20260808 08:40:50.017661 27938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:49.991940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36528 (local address 127.19.242.254:46577)
0808 08:40:49.992155 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:49.992160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:49.992751 (+ 591us) server_negotiation.cc:407] Connection header received
0808 08:40:49.993088 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:49.993093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:49.993186 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:49.993381 (+ 195us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:40:49.993924 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.994782 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.996293 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:49.996793 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:49.996962 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:49.997549 (+ 587us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:40:50.015717 (+ 18168us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:40:50.016192 (+ 475us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36528: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 08:40:50.017786 27938 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36528: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40253/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260808 08:40:50.019241 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 27838
I20260808 08:40:50.020720 27927 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:50.122957 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 27838
2026-08-08T08:40:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (852 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 08:40:50.187459 20427 mini_oidc.cc:152] Starting JWKS server
I20260808 08:40:50.189476 20427 webserver.cc:460] Webserver started at https://127.0.0.1:45441/ using document root <none> and password file <none>
I20260808 08:40:50.189724 20427 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:40:50.190375 20427 webserver.cc:460] Webserver started at http://127.0.0.1:33691/ using document root <none> and password file <none>
2026-08-08T08:40:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:50Z Disabled control of system clock
I20260808 08:40:50.229971 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44899
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:44899
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45441/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:40:50.592383 27988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:50.592725 27988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:50.592881 27988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:50.600769 27988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:50.600924 27988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:50.600994 27988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:50.601090 27988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:50.601183 27988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:40:50.601281 27988 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:40:50.601361 27988 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45441/jwks.json
I20260808 08:40:50.611479 27988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:44899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45441/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:50.613041 27988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:50.615161 27988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:50.629771 27999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:50.629876 27998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:50.632155 28005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:50.632195 27988 server_base.cc:1034] running on GCE node
I20260808 08:40:50.633279 27988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:50.635030 27988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:50.636312 27988 hybrid_clock.cc:648] HybridClock initialized: now 1786178450636233 us; error 65 us; skew 500 ppm
I20260808 08:40:50.636890 27988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:50.639801 27988 webserver.cc:460] Webserver started at http://127.19.242.254:41919/ using document root <none> and password file <none>
I20260808 08:40:50.640733 27988 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:50.640872 27988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:50.641296 27988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:50.645008 27988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "6a8beeb05057411390a0c8dc4f0f947e"
format_stamp: "Formatted at 2026-08-08 08:40:50 on dist-test-slave-39l8"
server_key: "99f01eaee91690abc2c9e2af67c5f040"
server_key_iv: "d94039c71214bd4028b8660c4be6819a"
server_key_version: "encryptionkey@0"
I20260808 08:40:50.646059 27988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "6a8beeb05057411390a0c8dc4f0f947e"
format_stamp: "Formatted at 2026-08-08 08:40:50 on dist-test-slave-39l8"
server_key: "99f01eaee91690abc2c9e2af67c5f040"
server_key_iv: "d94039c71214bd4028b8660c4be6819a"
server_key_version: "encryptionkey@0"
I20260808 08:40:50.652797 27988 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260808 08:40:50.657322 28012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:50.659039 27988 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:50.659229 27988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "6a8beeb05057411390a0c8dc4f0f947e"
format_stamp: "Formatted at 2026-08-08 08:40:50 on dist-test-slave-39l8"
server_key: "99f01eaee91690abc2c9e2af67c5f040"
server_key_iv: "d94039c71214bd4028b8660c4be6819a"
server_key_version: "encryptionkey@0"
I20260808 08:40:50.659459 27988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:50.728329 27988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:50.729288 27988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:50.729599 27988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:50.749739 28072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:44899 every 8 connection(s)
I20260808 08:40:50.749733 27988 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:44899
I20260808 08:40:50.751443 27988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:50.756446 28074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:50.760109 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 27988
I20260808 08:40:50.760381 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:50.761197 20427 external_mini_cluster.cc:1428] Setting key b3da3484c33cba81e8e3c8854defda6a
I20260808 08:40:50.770563 28074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e: Bootstrap starting.
I20260808 08:40:50.774382 28074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:50.775846 28074 log.cc:824] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:50.776772 28077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:50.763746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46192 (local address 127.19.242.254:44899)
0808 08:40:50.764972 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:50.764984 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:50.765030 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:40:50.766959 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:50.766987 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:50.767529 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:50.768005 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:50.768654 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:50.769975 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:50.771467 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:50.772241 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:50.772479 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:50.773826 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:50.773834 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:50.773852 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:50.774493 (+ 641us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:50.774628 (+ 135us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:50.774662 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:50.774984 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:50.775247 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 08:40:50.775618 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":765,"thread_start_us":407,"threads_started":1}
I20260808 08:40:50.779620 28074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e: No bootstrap required, opened a new log
I20260808 08:40:50.781680 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:40:50.789355 28074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8beeb05057411390a0c8dc4f0f947e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44899 } }
I20260808 08:40:50.789776 28074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:50.789856 28074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a8beeb05057411390a0c8dc4f0f947e, State: Initialized, Role: FOLLOWER
I20260808 08:40:50.790452 28074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8beeb05057411390a0c8dc4f0f947e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44899 } }
I20260808 08:40:50.790735 28074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:50.790923 28074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:50.791154 28074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:50.793498 28074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8beeb05057411390a0c8dc4f0f947e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44899 } }
I20260808 08:40:50.794093 28074 leader_election.cc:302] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a8beeb05057411390a0c8dc4f0f947e; no voters:
I20260808 08:40:50.794796 28074 leader_election.cc:288] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:50.794979 28079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:50.795799 28079 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [term 1 LEADER]: Becoming Leader. State: Replica: 6a8beeb05057411390a0c8dc4f0f947e, State: Running, Role: LEADER
I20260808 08:40:50.796455 28079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8beeb05057411390a0c8dc4f0f947e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44899 } }
I20260808 08:40:50.797273 28074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:50.800186 28082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a8beeb05057411390a0c8dc4f0f947e. Latest consensus state: current_term: 1 leader_uuid: "6a8beeb05057411390a0c8dc4f0f947e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8beeb05057411390a0c8dc4f0f947e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44899 } } }
I20260808 08:40:50.800697 28082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:50.800138 28080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a8beeb05057411390a0c8dc4f0f947e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8beeb05057411390a0c8dc4f0f947e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44899 } } }
I20260808 08:40:50.801434 28080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:50.804389 28092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:50.812387 28092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:50.822139 28092 catalog_manager.cc:1347] Generated new cluster ID: 21972c6edd284b3bbe38c842641592eb
I20260808 08:40:50.822293 28092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:50.863454 28092 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:50.865087 28092 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:50.878898 28092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a8beeb05057411390a0c8dc4f0f947e: Generated new TSK 0
I20260808 08:40:50.880005 28092 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:40:50.911464 28077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:50.901821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46202 (local address 127.19.242.254:44899)
0808 08:40:50.902155 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:50.902169 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:50.902700 (+ 531us) server_negotiation.cc:407] Connection header received
0808 08:40:50.903098 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:50.903103 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:50.903197 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:50.903392 (+ 195us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:40:50.904084 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:50.904923 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:50.906619 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:50.907298 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:50.907707 (+ 409us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:50.908314 (+ 607us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:40:50.910689 (+ 2375us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45441/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:40:50.911206 (+ 517us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46202: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45441/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 08:40:50.911662 28077 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46202: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45441/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 08:40:50.914918 28111 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:50.901748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44899 (local address 127.0.0.1:46202)
0808 08:40:50.902493 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:50.902512 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:50.902841 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:50.903426 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:50.903431 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:50.903447 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:40:50.903860 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:50.903872 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:50.905114 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:50.905125 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:50.906420 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:50.906435 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:50.907751 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:50.907760 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:50.907932 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:50.907977 (+ 45us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:40:50.911052 (+ 3075us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45441/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:40:50.914423 (+ 3371us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.242.254:44899: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45441/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":600,"mutex_wait_us":2852,"thread_start_us":376,"threads_started":1}
I20260808 08:40:50.916520 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 27988
I20260808 08:40:50.918282 28068 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 08:40:50.925904 28112 webserver.cc:533] Webserver: sslize failed:
E20260808 08:40:50.926076 28112 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:40:51.020208 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 27988
2026-08-08T08:40:51Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (898 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T08:40:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:51Z Disabled control of system clock
I20260808 08:40:51.129002 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33573
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:40175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:33573
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/testchainca.cert with env {}
W20260808 08:40:51.509297 28118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:51.509649 28118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:51.509742 28118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:51.517527 28118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:51.517655 28118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:51.517693 28118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:51.517748 28118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:51.517794 28118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:40:51.517858 28118 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:40:51.517911 28118 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 08:40:51.528726 28118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:33573
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:51.530282 28118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:51.531665 28118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:51.544788 28125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:51.544931 28124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:51.544901 28128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:51.546262 28118 server_base.cc:1034] running on GCE node
I20260808 08:40:51.547446 28118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:51.549279 28118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:51.550539 28118 hybrid_clock.cc:648] HybridClock initialized: now 1786178451550464 us; error 73 us; skew 500 ppm
I20260808 08:40:51.551080 28118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:40:51.554184 28118 webserver.cc:460] Webserver started at http://127.19.242.254:36725/ using document root <none> and password file <none>
I20260808 08:40:51.555162 28118 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:51.555305 28118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:51.555698 28118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:51.559425 28118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "dca03f39486a4a48baecb4763c43835d"
format_stamp: "Formatted at 2026-08-08 08:40:51 on dist-test-slave-39l8"
server_key: "899576402ab54b9fbba3b5ed9e869a6f"
server_key_iv: "57f174f5759280b93ea63272fbb081d5"
server_key_version: "encryptionkey@0"
I20260808 08:40:51.560417 28118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "dca03f39486a4a48baecb4763c43835d"
format_stamp: "Formatted at 2026-08-08 08:40:51 on dist-test-slave-39l8"
server_key: "899576402ab54b9fbba3b5ed9e869a6f"
server_key_iv: "57f174f5759280b93ea63272fbb081d5"
server_key_version: "encryptionkey@0"
I20260808 08:40:51.566675 28118 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260808 08:40:51.571246 28136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:51.572907 28118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:40:51.573168 28118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "dca03f39486a4a48baecb4763c43835d"
format_stamp: "Formatted at 2026-08-08 08:40:51 on dist-test-slave-39l8"
server_key: "899576402ab54b9fbba3b5ed9e869a6f"
server_key_iv: "57f174f5759280b93ea63272fbb081d5"
server_key_version: "encryptionkey@0"
I20260808 08:40:51.573426 28118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:51.588923 28118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:51.589895 28118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:51.590237 28118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:51.611595 28118 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:33573
I20260808 08:40:51.611618 28213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:33573 every 8 connection(s)
I20260808 08:40:51.613214 28118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:51.617743 28214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:40:51.619372 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 28118
I20260808 08:40:51.619625 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:51.620452 20427 external_mini_cluster.cc:1428] Setting key a3bf5c6a009f61b591899fc7b4acb045
I20260808 08:40:51.635721 28214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d: Bootstrap starting.
I20260808 08:40:51.639170 28217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:51.622849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36790 (local address 127.19.242.254:33573)
0808 08:40:51.624218 (+ 1369us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:51.624244 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:51.624320 (+ 76us) server_negotiation.cc:407] Connection header received
0808 08:40:51.626330 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:51.626375 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:51.627262 (+ 887us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:51.627851 (+ 589us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:51.628507 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:51.630750 (+ 2243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:51.632564 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:51.633922 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:51.634186 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:51.635587 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:51.635600 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:51.635633 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:40:51.636493 (+ 860us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:51.636625 (+ 132us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:40:51.636657 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:51.636800 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:51.637102 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 08:40:51.637514 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":409,"threads_started":1}
I20260808 08:40:51.640466 28214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:51.641728 28214 log.cc:824] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:51.644313 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:40:51.645430 28214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d: No bootstrap required, opened a new log
I20260808 08:40:51.654016 28214 raft_consensus.cc:348] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca03f39486a4a48baecb4763c43835d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33573 } }
I20260808 08:40:51.654498 28214 raft_consensus.cc:374] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:51.654685 28214 raft_consensus.cc:729] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca03f39486a4a48baecb4763c43835d, State: Initialized, Role: FOLLOWER
I20260808 08:40:51.655486 28214 consensus_queue.cc:260] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca03f39486a4a48baecb4763c43835d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33573 } }
I20260808 08:40:51.655793 28214 raft_consensus.cc:388] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:51.655977 28214 raft_consensus.cc:482] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:51.656174 28214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:51.658778 28214 raft_consensus.cc:504] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca03f39486a4a48baecb4763c43835d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33573 } }
I20260808 08:40:51.659448 28214 leader_election.cc:302] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dca03f39486a4a48baecb4763c43835d; no voters:
I20260808 08:40:51.660194 28214 leader_election.cc:288] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:51.660434 28219 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:51.661216 28219 raft_consensus.cc:686] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [term 1 LEADER]: Becoming Leader. State: Replica: dca03f39486a4a48baecb4763c43835d, State: Running, Role: LEADER
I20260808 08:40:51.661895 28219 consensus_queue.cc:237] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca03f39486a4a48baecb4763c43835d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33573 } }
I20260808 08:40:51.662889 28214 sys_catalog.cc:564] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:51.665331 28220 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dca03f39486a4a48baecb4763c43835d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca03f39486a4a48baecb4763c43835d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33573 } } }
I20260808 08:40:51.665298 28221 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dca03f39486a4a48baecb4763c43835d. Latest consensus state: current_term: 1 leader_uuid: "dca03f39486a4a48baecb4763c43835d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca03f39486a4a48baecb4763c43835d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33573 } } }
I20260808 08:40:51.665777 28220 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:51.665840 28221 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:51.668538 28228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:51.676169 28228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:51.686951 28228 catalog_manager.cc:1347] Generated new cluster ID: 0774ca112c594469a1a80479ce374c5c
I20260808 08:40:51.687099 28228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:51.697983 28228 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:51.699538 28228 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:51.707206 28228 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dca03f39486a4a48baecb4763c43835d: Generated new TSK 0
I20260808 08:40:51.708389 28228 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:40:52.631664 28217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:51.732519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36796 (local address 127.19.242.254:33573)
0808 08:40:51.732717 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:51.732722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:51.733185 (+ 463us) server_negotiation.cc:407] Connection header received
0808 08:40:51.733485 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:51.733498 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:51.733579 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:51.733747 (+ 168us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:40:51.734428 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:51.735310 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:51.737497 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:51.738277 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:51.738431 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:51.739138 (+ 707us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:40:52.631008 (+891870us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:40:52.631402 (+ 394us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36796: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 08:40:52.631825 28217 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36796: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 08:40:52.632407 28254 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:51.732326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33573 (local address 127.0.0.1:36796)
0808 08:40:51.733030 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:51.733052 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:51.733252 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:51.733813 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:51.733819 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:51.733833 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:40:51.734240 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:51.734256 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:51.735465 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:51.735472 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:51.737258 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:51.737276 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:51.738515 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:51.738523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:51.738750 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:51.738811 (+ 61us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:40:52.631356 (+892545us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:40:52.631647 (+ 291us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.242.254:33573: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":388,"threads_started":1}
I20260808 08:40:52.633746 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 28118
I20260808 08:40:52.635154 28209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:52.741241 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 28118
2026-08-08T08:40:52Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1702 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (455 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1578 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:54 dist-test-slave-39l8 krb5kdc[28278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:54 dist-test-slave-39l8 krb5kdc[28278](info): set up 2 sockets
Aug 08 08:40:54 dist-test-slave-39l8 krb5kdc[28278](info): commencing operation
krb5kdc: starting...
W20260808 08:40:56.133283 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.004s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:40:56 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:40:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:40:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:40:56.419250 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44823
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:44823
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:56.781279 28293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:56.781634 28293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:56.781829 28293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:56.790061 28293 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:40:56.790199 28293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:56.790288 28293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:56.790421 28293 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:40:56.790491 28293 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:40:56.801168 28293 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:44823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:56.802695 28293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:56.804208 28293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:56.818238 28301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:56.818198 28303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:56.818291 28306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:56.821306 28293 server_base.cc:1034] running on GCE node
I20260808 08:40:56.822302 28293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:56.824086 28293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:56.825372 28293 hybrid_clock.cc:648] HybridClock initialized: now 1786178456825294 us; error 72 us; skew 500 ppm
I20260808 08:40:56.825779 28293 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:56 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:56.829443 28293 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:40:56.831333 28293 webserver.cc:460] Webserver started at http://127.19.242.254:40909/ using document root <none> and password file <none>
I20260808 08:40:56.832175 28293 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:56.832336 28293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:56.832687 28293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:56.836042 28293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "b8569f1419cb42889c2d39426ffaa26e"
format_stamp: "Formatted at 2026-08-08 08:40:56 on dist-test-slave-39l8"
server_key: "294042a6856ef7e2cd90b4b736d83417"
server_key_iv: "d00f156496a37f1fe8e416a96a165435"
server_key_version: "encryptionkey@0"
I20260808 08:40:56.836951 28293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "b8569f1419cb42889c2d39426ffaa26e"
format_stamp: "Formatted at 2026-08-08 08:40:56 on dist-test-slave-39l8"
server_key: "294042a6856ef7e2cd90b4b736d83417"
server_key_iv: "d00f156496a37f1fe8e416a96a165435"
server_key_version: "encryptionkey@0"
I20260808 08:40:56.843441 28293 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:40:56.848176 28314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:56.849800 28293 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260808 08:40:56.850042 28293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "b8569f1419cb42889c2d39426ffaa26e"
format_stamp: "Formatted at 2026-08-08 08:40:56 on dist-test-slave-39l8"
server_key: "294042a6856ef7e2cd90b4b736d83417"
server_key_iv: "d00f156496a37f1fe8e416a96a165435"
server_key_version: "encryptionkey@0"
I20260808 08:40:56.850291 28293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:56.869190 28293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:56.874557 28293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:56.874954 28293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:56.895982 28293 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:44823
I20260808 08:40:56.896019 28386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:44823 every 8 connection(s)
I20260808 08:40:56.897513 28293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:40:56.899420 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 28293
I20260808 08:40:56.899663 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:40:56.900517 20427 external_mini_cluster.cc:1428] Setting key 036a688caf44ddc8e7ba9e9d1cf21e3d
I20260808 08:40:56.902580 28387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:40:56 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:56.915235 28387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e: Bootstrap starting.
I20260808 08:40:56.919176 28387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e: Neither blocks nor log segments found. Creating new log.
I20260808 08:40:56.920395 28387 log.cc:824] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:40:56.924263 28387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e: No bootstrap required, opened a new log
I20260808 08:40:56.924721 28390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:56.902850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59868 (local address 127.19.242.254:44823)
0808 08:40:56.903714 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:56.903727 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:56.903772 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:40:56.905484 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:56.905508 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:56.905967 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:56.906430 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:56.908062 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:56.909512 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:56.910902 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:56.911648 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:56.911909 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:56.916458 (+ 4549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:56.916466 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:56.916482 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:56.916532 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:56.920035 (+ 3503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:56.920987 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:56.920995 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:56.921003 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:56.921211 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:56.921646 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:56.921650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:56.921652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:56.922260 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:56.922612 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:56.923102 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 08:40:56.923579 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":383,"threads_started":1}
I20260808 08:40:56.933912 28387 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8569f1419cb42889c2d39426ffaa26e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44823 } }
I20260808 08:40:56.934463 28387 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:40:56.934651 28387 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8569f1419cb42889c2d39426ffaa26e, State: Initialized, Role: FOLLOWER
I20260808 08:40:56.935456 28387 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8569f1419cb42889c2d39426ffaa26e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44823 } }
I20260808 08:40:56.935734 28387 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:40:56.935912 28387 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:40:56.936118 28387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:40:56.938638 28387 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8569f1419cb42889c2d39426ffaa26e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44823 } }
I20260808 08:40:56.939419 28387 leader_election.cc:302] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8569f1419cb42889c2d39426ffaa26e; no voters:
I20260808 08:40:56.940171 28387 leader_election.cc:288] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:40:56.940368 28392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:40:56.941200 28392 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [term 1 LEADER]: Becoming Leader. State: Replica: b8569f1419cb42889c2d39426ffaa26e, State: Running, Role: LEADER
I20260808 08:40:56.941800 28392 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8569f1419cb42889c2d39426ffaa26e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44823 } }
I20260808 08:40:56.942759 28387 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:40:56.945170 28393 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8569f1419cb42889c2d39426ffaa26e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8569f1419cb42889c2d39426ffaa26e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44823 } } }
I20260808 08:40:56.945065 28394 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8569f1419cb42889c2d39426ffaa26e. Latest consensus state: current_term: 1 leader_uuid: "b8569f1419cb42889c2d39426ffaa26e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8569f1419cb42889c2d39426ffaa26e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44823 } } }
I20260808 08:40:56.945688 28394 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:56.945688 28393 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e [sys.catalog]: This master's current role is: LEADER
I20260808 08:40:56.947419 28402 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:40:56.954399 28402 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:40:56.964949 28402 catalog_manager.cc:1347] Generated new cluster ID: eb3408f32dac439996c1868d0a491390
I20260808 08:40:56.965212 28402 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:40:56.995608 28402 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:40:56.997221 28402 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:40:57.010862 28402 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8569f1419cb42889c2d39426ffaa26e: Generated new TSK 0
I20260808 08:40:57.012147 28402 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:40:57.078913 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44823
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:57.457237 28422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:57.457605 28422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:57.457790 28422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:57.465473 28422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:57.465680 28422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:57.465878 28422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:40:57.476257 28422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:57.477825 28422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:57.479279 28422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:57.493608 28430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:57.493697 28432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:57.493649 28428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:57.494851 28422 server_base.cc:1034] running on GCE node
I20260808 08:40:57.495664 28422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:57.496798 28422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:57.498091 28422 hybrid_clock.cc:648] HybridClock initialized: now 1786178457497995 us; error 95 us; skew 500 ppm
I20260808 08:40:57.498505 28422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:57 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:57.502163 28422 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:40:57.503943 28422 webserver.cc:460] Webserver started at http://127.19.242.193:44479/ using document root <none> and password file <none>
I20260808 08:40:57.504743 28422 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:57.504910 28422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:57.505263 28422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:57.508687 28422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "0cf0fb4dfbc942b492eb4f32c90505e5"
format_stamp: "Formatted at 2026-08-08 08:40:57 on dist-test-slave-39l8"
server_key: "cc01f93231aeeff040bb604c8bfcc3ff"
server_key_iv: "8bb1f6ed9e22c18a55123258505fd41f"
server_key_version: "encryptionkey@0"
I20260808 08:40:57.509708 28422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "0cf0fb4dfbc942b492eb4f32c90505e5"
format_stamp: "Formatted at 2026-08-08 08:40:57 on dist-test-slave-39l8"
server_key: "cc01f93231aeeff040bb604c8bfcc3ff"
server_key_iv: "8bb1f6ed9e22c18a55123258505fd41f"
server_key_version: "encryptionkey@0"
I20260808 08:40:57.516039 28422 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 08:40:57.520390 28444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:57.522096 28422 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:40:57.522441 28422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "0cf0fb4dfbc942b492eb4f32c90505e5"
format_stamp: "Formatted at 2026-08-08 08:40:57 on dist-test-slave-39l8"
server_key: "cc01f93231aeeff040bb604c8bfcc3ff"
server_key_iv: "8bb1f6ed9e22c18a55123258505fd41f"
server_key_version: "encryptionkey@0"
I20260808 08:40:57.522761 28422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:57.536755 28422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:57.541958 28422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:57.542364 28422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:57.543926 28422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:57.545723 28422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:57.545845 28422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:57.546027 28422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:57.546129 28422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:57.582366 28422 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:46817
I20260808 08:40:57.582482 28594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:46817 every 8 connection(s)
I20260808 08:40:57.583885 28422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:40:57.589867 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 28422
I20260808 08:40:57.590094 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:40:57.590960 20427 external_mini_cluster.cc:1428] Setting key e62bd3181b84c5da6a914a66a1d6e9d5
Aug 08 08:40:57 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:57.606781 28599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:57.586881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:32799 (local address 127.19.242.254:44823)
0808 08:40:57.587399 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:57.587406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:57.588528 (+ 1122us) server_negotiation.cc:407] Connection header received
0808 08:40:57.590606 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:57.590614 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:57.590757 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:57.590897 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:57.592848 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:57.593583 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:57.595394 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:57.595820 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:57.595976 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:57.600259 (+ 4283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:57.600265 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:57.600268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:57.600310 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:57.603216 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:57.604136 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:57.604142 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:57.604144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:57.604283 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:57.604800 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:57.604812 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:57.604815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:57.605101 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:57.605292 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:57.606103 (+ 811us) server_negotiation.cc:299] Negotiation successful
0808 08:40:57.606364 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":223,"threads_started":1}
I20260808 08:40:57.608143 28604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:57.587488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44823 (local address 127.19.242.193:32799)
0808 08:40:57.588325 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:57.588383 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:57.590263 (+ 1880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:57.591181 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:57.591191 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:57.591970 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:57.592643 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:57.592663 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:57.593779 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:57.593783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:57.595205 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:57.595221 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:57.596098 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:57.596106 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:57.596374 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:57.597156 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:57.597182 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:57.599951 (+ 2769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:57.603417 (+ 3466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:57.603429 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:57.603457 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:57.603967 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:57.604416 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:57.604421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:57.604425 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:57.604653 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:57.605262 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:57.605271 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:57.605675 (+ 404us) client_negotiation.cc:769] Sending connection context
0808 08:40:57.605976 (+ 301us) client_negotiation.cc:240] Negotiation successful
0808 08:40:57.606606 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":310,"threads_started":1}
I20260808 08:40:57.610132 28595 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44823
I20260808 08:40:57.610532 28595 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:57.611629 28595 heartbeater.cc:511] Master 127.19.242.254:44823 requested a full tablet report, sending...
I20260808 08:40:57.614507 28338 ts_manager.cc:194] Registered new tserver with Master: 0cf0fb4dfbc942b492eb4f32c90505e5 (127.19.242.193:46817)
I20260808 08:40:57.616153 28338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:32799
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:40:57.654533 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44823
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:58.031032 28608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:58.031605 28608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:58.031811 28608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:58.039803 28608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:58.039938 28608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:58.040117 28608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:40:58.051126 28608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:58.052640 28608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:58.054036 28608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:58.068427 28616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:58.068387 28617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:58.068473 28620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:58.069453 28608 server_base.cc:1034] running on GCE node
I20260808 08:40:58.070269 28608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:58.071465 28608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:58.072760 28608 hybrid_clock.cc:648] HybridClock initialized: now 1786178458072712 us; error 41 us; skew 500 ppm
I20260808 08:40:58.073167 28608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.076956 28608 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:40:58.078617 28608 webserver.cc:460] Webserver started at http://127.19.242.194:46391/ using document root <none> and password file <none>
I20260808 08:40:58.079442 28608 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:58.079555 28608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:58.079830 28608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:58.083329 28608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "fca9b21c36b04e1aba1abaaad8963d4d"
format_stamp: "Formatted at 2026-08-08 08:40:58 on dist-test-slave-39l8"
server_key: "e55f2064df06020ea047f2dcf625ce46"
server_key_iv: "ecec3f918192a1f170df5849e4b33607"
server_key_version: "encryptionkey@0"
I20260808 08:40:58.084210 28608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "fca9b21c36b04e1aba1abaaad8963d4d"
format_stamp: "Formatted at 2026-08-08 08:40:58 on dist-test-slave-39l8"
server_key: "e55f2064df06020ea047f2dcf625ce46"
server_key_iv: "ecec3f918192a1f170df5849e4b33607"
server_key_version: "encryptionkey@0"
I20260808 08:40:58.090440 28608 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260808 08:40:58.095290 28631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:58.096978 28608 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:40:58.097199 28608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "fca9b21c36b04e1aba1abaaad8963d4d"
format_stamp: "Formatted at 2026-08-08 08:40:58 on dist-test-slave-39l8"
server_key: "e55f2064df06020ea047f2dcf625ce46"
server_key_iv: "ecec3f918192a1f170df5849e4b33607"
server_key_version: "encryptionkey@0"
I20260808 08:40:58.097437 28608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:58.112737 28608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:58.117817 28608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:58.118180 28608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:58.119442 28608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:58.120960 28608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:58.121044 28608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:58.121223 28608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:58.121294 28608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:58.157900 28608 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45647
I20260808 08:40:58.158012 28777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45647 every 8 connection(s)
I20260808 08:40:58.159384 28608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:40:58.164592 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 28608
I20260808 08:40:58.164809 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:40:58.165390 20427 external_mini_cluster.cc:1428] Setting key cf750a4ef52c28248a6dd8f6dc0fe46c
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:58.187265 28782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.162928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44823 (local address 127.19.242.194:38751)
0808 08:40:58.163721 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:58.163772 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:58.166166 (+ 2394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:58.167047 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:58.167057 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:58.167889 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:58.168832 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:58.168866 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.170020 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.170029 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:58.172334 (+ 2305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:58.172355 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.173443 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.173457 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:58.173857 (+ 400us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.174875 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:58.174914 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:58.178683 (+ 3769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:58.182254 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:58.182265 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:58.182292 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:58.182883 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:58.183340 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:58.183346 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:58.183350 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:58.183577 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:58.184349 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:58.184358 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:58.184859 (+ 501us) client_negotiation.cc:769] Sending connection context
0808 08:40:58.185157 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 08:40:58.185756 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":289,"threads_started":1}
I20260808 08:40:58.188519 28781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.162413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:38751 (local address 127.19.242.254:44823)
0808 08:40:58.162933 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.162939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.163909 (+ 970us) server_negotiation.cc:407] Connection header received
0808 08:40:58.166565 (+ 2656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.166571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.166665 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.166817 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.169066 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.169821 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.172528 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.173076 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.173249 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.179060 (+ 5811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:58.179068 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:58.179074 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:58.179121 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:58.182043 (+ 2922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.183050 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.183055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.183057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.183207 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.183729 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.183737 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.183740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.184098 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:58.184265 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:58.187894 (+ 3629us) server_negotiation.cc:299] Negotiation successful
0808 08:40:58.188155 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":233,"threads_started":1}
I20260808 08:40:58.190809 28778 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44823
I20260808 08:40:58.191176 28778 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:58.192140 28778 heartbeater.cc:511] Master 127.19.242.254:44823 requested a full tablet report, sending...
I20260808 08:40:58.194005 28338 ts_manager.cc:194] Registered new tserver with Master: fca9b21c36b04e1aba1abaaad8963d4d (127.19.242.194:45647)
I20260808 08:40:58.195601 28338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:38751
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:40:58.234318 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44823
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:40:58.604871 28788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:40:58.605247 28788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:40:58.605360 28788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:40:58.614326 28788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:40:58.614480 28788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:40:58.614601 28788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:40:58.620414 28595 heartbeater.cc:503] Master 127.19.242.254:44823 was elected leader, sending a full tablet report...
I20260808 08:40:58.625948 28788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:40:58.627532 28788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:40:58.629055 28788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:40:58.643833 28798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:58.643882 28797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:40:58.643874 28800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:40:58.644946 28788 server_base.cc:1034] running on GCE node
I20260808 08:40:58.645743 28788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:40:58.647008 28788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:40:58.648293 28788 hybrid_clock.cc:648] HybridClock initialized: now 1786178458648221 us; error 91 us; skew 500 ppm
I20260808 08:40:58.648674 28788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.652287 28788 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:40:58.653957 28788 webserver.cc:460] Webserver started at http://127.19.242.195:41273/ using document root <none> and password file <none>
I20260808 08:40:58.654856 28788 fs_manager.cc:359] Metadata directory not provided
I20260808 08:40:58.654969 28788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:40:58.655252 28788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:40:58.658428 28788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "5fdd2283d8a44909aa5c44724d12de8c"
format_stamp: "Formatted at 2026-08-08 08:40:58 on dist-test-slave-39l8"
server_key: "9cb9fcb3ac4cca2e7b201c303f9ba091"
server_key_iv: "059aba9ae2bc6063b46f0095506ed9a5"
server_key_version: "encryptionkey@0"
I20260808 08:40:58.659369 28788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "5fdd2283d8a44909aa5c44724d12de8c"
format_stamp: "Formatted at 2026-08-08 08:40:58 on dist-test-slave-39l8"
server_key: "9cb9fcb3ac4cca2e7b201c303f9ba091"
server_key_iv: "059aba9ae2bc6063b46f0095506ed9a5"
server_key_version: "encryptionkey@0"
I20260808 08:40:58.665251 28788 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:40:58.669457 28808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:58.671232 28788 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:40:58.671455 28788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "5fdd2283d8a44909aa5c44724d12de8c"
format_stamp: "Formatted at 2026-08-08 08:40:58 on dist-test-slave-39l8"
server_key: "9cb9fcb3ac4cca2e7b201c303f9ba091"
server_key_iv: "059aba9ae2bc6063b46f0095506ed9a5"
server_key_version: "encryptionkey@0"
I20260808 08:40:58.671701 28788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:40:58.697181 28788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:40:58.702414 28788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:40:58.702801 28788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:40:58.703969 28788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:40:58.705787 28788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:40:58.705878 28788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:58.706022 28788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:40:58.706077 28788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:40:58.743607 28788 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:43289
I20260808 08:40:58.743722 28955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:43289 every 8 connection(s)
I20260808 08:40:58.745133 28788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:40:58.755349 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 28788
I20260808 08:40:58.755556 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:40:58.756142 20427 external_mini_cluster.cc:1428] Setting key b693d6998666e004510a361a15b18abb
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:40:58.767423 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.749060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:46437 (local address 127.19.242.254:44823)
0808 08:40:58.749584 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.749590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.749612 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:40:58.751608 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.751614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.751725 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.751866 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.753504 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.754344 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.756411 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.756986 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.757162 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.761078 (+ 3916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:58.761083 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:58.761086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:58.761124 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:58.763976 (+ 2852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.764845 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.764850 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.764852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.764980 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.765465 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.765469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.765471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.765755 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:58.765933 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:58.766760 (+ 827us) server_negotiation.cc:299] Negotiation successful
0808 08:40:58.767005 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":251,"threads_started":1}
I20260808 08:40:58.768469 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.748516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44823 (local address 127.19.242.195:46437)
0808 08:40:58.749384 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0808 08:40:58.749440 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:40:58.751309 (+ 1869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:40:58.752138 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:40:58.752148 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:40:58.752708 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:40:58.753303 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:58.753327 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.754541 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.754545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:58.756155 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:40:58.756173 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.757283 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.757295 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:40:58.757575 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.758394 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:40:58.758421 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:40:58.760825 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:40:58.764156 (+ 3331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:58.764167 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:58.764188 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:58.764691 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:58.765103 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:40:58.765108 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:40:58.765112 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:40:58.765324 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:40:58.765898 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:40:58.765907 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:40:58.766300 (+ 393us) client_negotiation.cc:769] Sending connection context
0808 08:40:58.766613 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 08:40:58.767259 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":325,"threads_started":1}
I20260808 08:40:58.770123 28958 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44823
I20260808 08:40:58.770521 28958 heartbeater.cc:464] Registering TS with master...
I20260808 08:40:58.771375 28958 heartbeater.cc:511] Master 127.19.242.254:44823 requested a full tablet report, sending...
I20260808 08:40:58.772861 28338 ts_manager.cc:194] Registered new tserver with Master: 5fdd2283d8a44909aa5c44724d12de8c (127.19.242.195:43289)
I20260808 08:40:58.773718 28338 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:46437
I20260808 08:40:58.785517 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/test-admin.keytab.
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.821544 20427 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 08:40:58.827720 28967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:58.824656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46746 (local address 127.19.242.193:46817)
0808 08:40:58.825406 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.825413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.825441 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:40:58.825505 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.825512 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.825735 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.825872 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.827160 (+ 1288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46746: BlockingRecv error: recv got EOF from 127.0.0.1:46746 (error 108)
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":420,"threads_started":1}
W20260808 08:40:58.827796 20427 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.829574 20427 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.831125 20427 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:58.849535 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.833179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46754 (local address 127.19.242.193:46817)
0808 08:40:58.833419 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.833426 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.833663 (+ 237us) server_negotiation.cc:407] Connection header received
0808 08:40:58.833908 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.833913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.833979 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.834161 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.835386 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.836377 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.837717 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.838342 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.838504 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.842852 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:58.842869 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:58.842887 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:58.842932 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:58.846127 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.847109 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.847117 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.847120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.847259 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.847694 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.847698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.847701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.848224 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:58.848558 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:58.848937 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 08:40:58.849238 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 08:40:58.856190 28967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:58.854135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46770 (local address 127.19.242.193:46817)
0808 08:40:58.854377 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.854384 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.854582 (+ 198us) server_negotiation.cc:407] Connection header received
0808 08:40:58.854910 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.854916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.855037 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.855147 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.855944 (+ 797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46770: BlockingRecv error: recv got EOF from 127.0.0.1:46770 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 08:40:58.856647 20427 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.858582 20427 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.860170 20427 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:58.878222 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.861719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46778 (local address 127.19.242.193:46817)
0808 08:40:58.861964 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.861971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.862254 (+ 283us) server_negotiation.cc:407] Connection header received
0808 08:40:58.862402 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.862406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.862472 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.862562 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.863829 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.864635 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.865964 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.866422 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.866523 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.871409 (+ 4886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:58.871416 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:58.871420 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:58.871486 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:58.874873 (+ 3387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.875767 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.875772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.875775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.875977 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.876572 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.876578 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.876582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.876921 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:58.877267 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:58.877626 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 08:40:58.877889 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 08:40:58.883445 28967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:40:58.881289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46780 (local address 127.19.242.193:46817)
0808 08:40:58.881506 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.881514 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.881843 (+ 329us) server_negotiation.cc:407] Connection header received
0808 08:40:58.882057 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.882061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.882139 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.882255 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.883127 (+ 872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46780: BlockingRecv error: recv got EOF from 127.0.0.1:46780 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 08:40:58.883764 20427 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178398071314-20427-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.885401 20427 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:40:58.886911 20427 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:40:58 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:40:58.903811 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.888507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46796 (local address 127.19.242.193:46817)
0808 08:40:58.888752 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.888759 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.888898 (+ 139us) server_negotiation.cc:407] Connection header received
0808 08:40:58.889128 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.889133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.889219 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.889315 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.890487 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.891405 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.892795 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.893258 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.893371 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.897679 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:58.897685 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:58.897688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:58.897732 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:58.900734 (+ 3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.901613 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.901621 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.901629 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.901802 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.902235 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.902241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.902244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.902585 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:58.902945 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:58.903246 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 08:40:58.903481 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:40:58.905562 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 28422
I20260808 08:40:58.919014 28967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:58.906397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46812 (local address 127.19.242.193:46817)
0808 08:40:58.906564 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:58.906569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:58.907008 (+ 439us) server_negotiation.cc:407] Connection header received
0808 08:40:58.907145 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:58.907150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:58.907212 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:58.907331 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:58.908319 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.908985 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.910298 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:58.910892 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:58.911017 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:58.913300 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:58.913306 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:58.913309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:58.913346 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:58.916137 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.916943 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.916947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.916950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.917150 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:58.917612 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:58.917616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:58.917618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:58.917918 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:58.918191 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:58.918460 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 08:40:58.918657 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:40:58.919724 28588 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:59.006582 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 28422
I20260808 08:40:59.037827 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 28608
Aug 08 08:40:59 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:40:59.056082 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:59.038845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39782 (local address 127.19.242.194:45647)
0808 08:40:59.039440 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:59.039447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:59.039473 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:40:59.039541 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:59.039547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:59.039763 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:59.039948 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:59.040996 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:59.042017 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:59.043522 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:59.044128 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:59.044289 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:59.048924 (+ 4635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:59.048941 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:59.048959 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:59.049007 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:59.052458 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:59.053389 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:59.053400 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:59.053402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:59.053578 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:59.054113 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:59.054117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:59.054119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:59.054606 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:59.054947 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:59.055469 (+ 522us) server_negotiation.cc:299] Negotiation successful
0808 08:40:59.055737 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":318,"threads_started":1}
I20260808 08:40:59.057667 28771 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:59.142292 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 28608
I20260808 08:40:59.166486 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 28788
Aug 08 08:40:59 dist-test-slave-39l8 krb5kdc[28278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:40:59.184919 28991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:40:59.167694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.19.242.195:43289)
0808 08:40:59.168419 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0808 08:40:59.168427 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:40:59.168460 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:40:59.168525 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:40:59.168533 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:40:59.168815 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:40:59.169009 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:40:59.170152 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:59.171283 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:59.172564 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:40:59.173161 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:40:59.173313 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:40:59.177834 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:40:59.177849 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:40:59.177867 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:40:59.177917 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:40:59.181476 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:59.182390 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:59.182399 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:59.182401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:59.182566 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:40:59.183079 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:40:59.183091 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:40:59.183094 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:40:59.183501 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:40:59.183774 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 08:40:59.184187 (+ 413us) server_negotiation.cc:299] Negotiation successful
0808 08:40:59.184519 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":358,"threads_started":1}
I20260808 08:40:59.186461 28951 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:59.274171 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 28788
I20260808 08:40:59.303049 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 28293
I20260808 08:40:59.304653 28382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:40:59.414547 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 28293
2026-08-08T08:40:59Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4640 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:40:59 dist-test-slave-39l8 krb5kdc[28998](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:40:59 dist-test-slave-39l8 krb5kdc[28998](info): set up 2 sockets
Aug 08 08:40:59 dist-test-slave-39l8 krb5kdc[28998](info): commencing operation
krb5kdc: starting...
W20260808 08:41:00.753510 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:41:00 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:41:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:00Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab.
Entry for principal oryx/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab.
I20260808 08:41:01.054497 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35585
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab
--principal=oryx/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:35585
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:01.413033 29016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:01.413414 29016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:01.413585 29016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:01.421159 29016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:01.421350 29016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:01.421469 29016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:01.421569 29016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:01.421658 29016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:01.431977 29016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:35585
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab
--principal=oryx/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35585
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:01.433493 29016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:01.435015 29016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:01.447825 29022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:01.447866 29026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:01.447880 29024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:01.449247 29016 server_base.cc:1034] running on GCE node
I20260808 08:41:01.450073 29016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:01.451709 29016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:01.452941 29016 hybrid_clock.cc:648] HybridClock initialized: now 1786178461452867 us; error 77 us; skew 500 ppm
I20260808 08:41:01.453296 29016 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:01 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178461, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:01.456828 29016 init.cc:377] Logged in from keytab as oryx/127.19.242.254@KRBTEST.COM (short username oryx)
I20260808 08:41:01.458482 29016 webserver.cc:460] Webserver started at http://127.19.242.254:41691/ using document root <none> and password file <none>
I20260808 08:41:01.459334 29016 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:01.459486 29016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:01.459842 29016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:01.463195 29016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "fc5386c578ab40328a4c15e4bad3a9f0"
format_stamp: "Formatted at 2026-08-08 08:41:01 on dist-test-slave-39l8"
server_key: "62d9bb2e5739a080d9fb464212008c48"
server_key_iv: "b0de04d1d1272256ba7d999784357bdf"
server_key_version: "encryptionkey@0"
I20260808 08:41:01.464167 29016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "fc5386c578ab40328a4c15e4bad3a9f0"
format_stamp: "Formatted at 2026-08-08 08:41:01 on dist-test-slave-39l8"
server_key: "62d9bb2e5739a080d9fb464212008c48"
server_key_iv: "b0de04d1d1272256ba7d999784357bdf"
server_key_version: "encryptionkey@0"
I20260808 08:41:01.470196 29016 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:41:01.474438 29037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:01.476191 29016 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:01.476435 29016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "fc5386c578ab40328a4c15e4bad3a9f0"
format_stamp: "Formatted at 2026-08-08 08:41:01 on dist-test-slave-39l8"
server_key: "62d9bb2e5739a080d9fb464212008c48"
server_key_iv: "b0de04d1d1272256ba7d999784357bdf"
server_key_version: "encryptionkey@0"
I20260808 08:41:01.476678 29016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:01.513643 29016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:01.518368 29016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:01.518749 29016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:01.539288 29016 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:35585
I20260808 08:41:01.539350 29111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:35585 every 8 connection(s)
I20260808 08:41:01.540916 29016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:41:01.544337 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 29016
I20260808 08:41:01.544582 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:41:01.545114 29113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:01.545337 20427 external_mini_cluster.cc:1428] Setting key 48f391047d138aaaf3d16c68382aa662
I20260808 08:41:01.561277 29113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: Bootstrap starting.
Aug 08 08:41:01 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:01.565260 29113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:01.567016 29113 log.cc:824] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:01.570998 29113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: No bootstrap required, opened a new log
I20260808 08:41:01.573637 29116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:01.547520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.19.242.254:35585)
0808 08:41:01.548481 (+ 961us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:01.548495 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:01.548541 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:41:01.550262 (+ 1721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:01.550288 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:01.550810 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:01.551203 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:01.553433 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:01.554962 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:01.556824 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:01.557602 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:01.557748 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:01.563162 (+ 5414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:01.563178 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:01.563202 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:01.563273 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:01.567833 (+ 4560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:01.568987 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:01.568997 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:01.569006 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:01.569256 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:01.569769 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:01.569774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:01.569777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:01.570528 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:01.570870 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:01.571489 (+ 619us) server_negotiation.cc:299] Negotiation successful
0808 08:41:01.572051 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":493,"threads_started":1}
I20260808 08:41:01.580843 29113 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } }
I20260808 08:41:01.581400 29113 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:01.581533 29113 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc5386c578ab40328a4c15e4bad3a9f0, State: Initialized, Role: FOLLOWER
I20260808 08:41:01.582204 29113 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } }
I20260808 08:41:01.582477 29113 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:41:01.582657 29113 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:41:01.582881 29113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:01.585264 29113 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } }
I20260808 08:41:01.585960 29113 leader_election.cc:302] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc5386c578ab40328a4c15e4bad3a9f0; no voters:
I20260808 08:41:01.586867 29113 leader_election.cc:288] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:41:01.587005 29118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:01.589000 29118 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 1 LEADER]: Becoming Leader. State: Replica: fc5386c578ab40328a4c15e4bad3a9f0, State: Running, Role: LEADER
I20260808 08:41:01.589442 29113 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:01.589705 29118 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } }
I20260808 08:41:01.593351 29122 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc5386c578ab40328a4c15e4bad3a9f0. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } }
I20260808 08:41:01.593218 29120 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } }
I20260808 08:41:01.593684 29120 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:01.593684 29122 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:01.600906 29130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:01.607287 29130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:01.618319 29130 catalog_manager.cc:1347] Generated new cluster ID: 393093ccd3814d2c97b2e402dbbd8458
I20260808 08:41:01.618462 29130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:01.642408 29130 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:41:01.644448 29130 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:01.655308 29130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: Generated new TSK 0
I20260808 08:41:01.656565 29130 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab.
Entry for principal oryx/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab.
I20260808 08:41:01.726052 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35585
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab
--principal=oryx/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:02.113076 29148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:02.113418 29148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:02.113583 29148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:02.121390 29148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:02.121541 29148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:02.121740 29148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:02.132339 29148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab
--principal=oryx/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:02.133821 29148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:02.135435 29148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:02.149950 29155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:02.150132 29157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:02.150367 29159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:02.151358 29148 server_base.cc:1034] running on GCE node
I20260808 08:41:02.152130 29148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:02.153367 29148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:02.154676 29148 hybrid_clock.cc:648] HybridClock initialized: now 1786178462154569 us; error 63 us; skew 500 ppm
I20260808 08:41:02.155078 29148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:02 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178462, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:02.159209 29148 init.cc:377] Logged in from keytab as oryx/127.19.242.193@KRBTEST.COM (short username oryx)
I20260808 08:41:02.161072 29148 webserver.cc:460] Webserver started at http://127.19.242.193:38825/ using document root <none> and password file <none>
I20260808 08:41:02.161921 29148 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:02.162086 29148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:02.162457 29148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:02.166010 29148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "9e63794ec66c43b0ae08bdffd18aaf5b"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "bbd4f36584b5a837c4251eb4960c7dc0"
server_key_iv: "8f0602ea4de0f14e775aa2174eac2a45"
server_key_version: "encryptionkey@0"
I20260808 08:41:02.167024 29148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "9e63794ec66c43b0ae08bdffd18aaf5b"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "bbd4f36584b5a837c4251eb4960c7dc0"
server_key_iv: "8f0602ea4de0f14e775aa2174eac2a45"
server_key_version: "encryptionkey@0"
I20260808 08:41:02.173488 29148 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:41:02.178282 29170 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:02.180751 29148 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:41:02.181001 29148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "9e63794ec66c43b0ae08bdffd18aaf5b"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "bbd4f36584b5a837c4251eb4960c7dc0"
server_key_iv: "8f0602ea4de0f14e775aa2174eac2a45"
server_key_version: "encryptionkey@0"
I20260808 08:41:02.181274 29148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:02.207998 29148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:02.213338 29148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:02.213712 29148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:02.215001 29148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:02.216670 29148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:02.216791 29148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:02.216970 29148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:02.217056 29148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:02.257411 29148 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:32907
I20260808 08:41:02.257439 29330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:32907 every 8 connection(s)
I20260808 08:41:02.258978 29148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:02.267671 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 29148
I20260808 08:41:02.267931 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:41:02.268637 20427 external_mini_cluster.cc:1428] Setting key 91fed94fae9f821dee0f349ebc2657ea
Aug 08 08:41:02 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178462, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:02.285164 29333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:02.261915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:36929 (local address 127.19.242.254:35585)
0808 08:41:02.262493 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:02.262498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:02.263439 (+ 941us) server_negotiation.cc:407] Connection header received
0808 08:41:02.265459 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:02.265467 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:02.265582 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:02.265715 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:02.267726 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.268715 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.271087 (+ 2372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.271684 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.271840 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:02.276531 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:02.276542 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:02.276548 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:02.276605 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:02.280746 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:02.281996 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:02.282006 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:02.282012 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:02.282198 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:02.282856 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:02.282861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:02.282863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:02.283163 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:02.283346 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:02.284553 (+ 1207us) server_negotiation.cc:299] Negotiation successful
0808 08:41:02.284787 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":350,"threads_started":1}
I20260808 08:41:02.286890 29334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:02.262407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.193:36929)
0808 08:41:02.263256 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:02.263301 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:02.265132 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:02.265985 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:02.265995 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:02.266587 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:02.267451 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:02.267481 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.268992 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.268999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:02.270888 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:02.270905 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.272022 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.272034 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:02.272421 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:02.273295 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:02.273321 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:02.276134 (+ 2813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:02.280987 (+ 4853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:02.280997 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:02.281017 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:02.281824 (+ 807us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:02.282328 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:02.282331 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:02.282334 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:02.282630 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:02.283365 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:02.283376 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:02.283959 (+ 583us) client_negotiation.cc:769] Sending connection context
0808 08:41:02.284337 (+ 378us) client_negotiation.cc:240] Negotiation successful
0808 08:41:02.285047 (+ 710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":362,"threads_started":1}
I20260808 08:41:02.288723 29331 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35585
I20260808 08:41:02.289075 29331 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:02.289986 29331 heartbeater.cc:511] Master 127.19.242.254:35585 requested a full tablet report, sending...
I20260808 08:41:02.292496 29066 ts_manager.cc:194] Registered new tserver with Master: 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907)
I20260808 08:41:02.294143 29066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:36929
WARNING: no policy specified for oryx/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab.
Entry for principal oryx/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab.
I20260808 08:41:02.334342 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35585
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab
--principal=oryx/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:02.700327 29337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:02.700655 29337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:02.700853 29337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:02.708582 29337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:02.708715 29337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:02.708913 29337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:02.719367 29337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab
--principal=oryx/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:02.720800 29337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:02.722239 29337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:02.736294 29346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:02.736506 29345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:02.736339 29348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:02.737612 29337 server_base.cc:1034] running on GCE node
I20260808 08:41:02.738356 29337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:02.739517 29337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:02.740784 29337 hybrid_clock.cc:648] HybridClock initialized: now 1786178462740740 us; error 46 us; skew 500 ppm
I20260808 08:41:02.741130 29337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:02 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178462, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:02.744772 29337 init.cc:377] Logged in from keytab as oryx/127.19.242.194@KRBTEST.COM (short username oryx)
I20260808 08:41:02.746508 29337 webserver.cc:460] Webserver started at http://127.19.242.194:41137/ using document root <none> and password file <none>
I20260808 08:41:02.747349 29337 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:02.747510 29337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:02.747862 29337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:02.751109 29337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "c4f56bcae994400c89614373615de47a"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "d8c14e850472d2231b34f7e6cf1a7949"
server_key_iv: "893a10f3d0a68177a7a32b8e138c881a"
server_key_version: "encryptionkey@0"
I20260808 08:41:02.752082 29337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "c4f56bcae994400c89614373615de47a"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "d8c14e850472d2231b34f7e6cf1a7949"
server_key_iv: "893a10f3d0a68177a7a32b8e138c881a"
server_key_version: "encryptionkey@0"
I20260808 08:41:02.758227 29337 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:41:02.762943 29362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:02.764688 29337 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:41:02.764915 29337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "c4f56bcae994400c89614373615de47a"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "d8c14e850472d2231b34f7e6cf1a7949"
server_key_iv: "893a10f3d0a68177a7a32b8e138c881a"
server_key_version: "encryptionkey@0"
I20260808 08:41:02.765166 29337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:02.789796 29337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:02.795192 29337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:02.795540 29337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:02.796634 29337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:02.798152 29337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:02.798276 29337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:02.798447 29337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:02.798523 29337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:02.835724 29337 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:40985
I20260808 08:41:02.835820 29531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:40985 every 8 connection(s)
I20260808 08:41:02.837136 29337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:02.844884 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 29337
I20260808 08:41:02.845098 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:41:02.845700 20427 external_mini_cluster.cc:1428] Setting key f2eb64af2e58f809311eddcce5305363
Aug 08 08:41:02 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178462, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:02.861820 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:02.839964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:46727 (local address 127.19.242.254:35585)
0808 08:41:02.840469 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:02.840474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:02.841579 (+ 1105us) server_negotiation.cc:407] Connection header received
0808 08:41:02.843566 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:02.843571 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:02.843660 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:02.843767 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:02.846029 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.846976 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.849337 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.849752 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.849849 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:02.854977 (+ 5128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:02.854983 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:02.854986 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:02.855027 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:02.857934 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:02.858803 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:02.858812 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:02.858818 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:02.858992 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:02.859707 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:02.859721 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:02.859726 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:02.860153 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:02.860325 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:02.861352 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0808 08:41:02.861540 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":275,"threads_started":1}
I20260808 08:41:02.863651 29535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:02.840621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.194:46727)
0808 08:41:02.841401 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:02.841441 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:02.843260 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:02.843995 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:02.844004 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:02.844845 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:02.845790 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:02.845825 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.847164 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.847170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:02.849150 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:02.849170 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:02.850009 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:02.850020 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:02.850405 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:02.851354 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:02.851393 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:02.854602 (+ 3209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:02.858110 (+ 3508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:02.858121 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:02.858142 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:02.858633 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:02.859164 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:02.859171 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:02.859177 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:02.859537 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:02.860315 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:02.860351 (+ 36us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:02.860910 (+ 559us) client_negotiation.cc:769] Sending connection context
0808 08:41:02.861252 (+ 342us) client_negotiation.cc:240] Negotiation successful
0808 08:41:02.861916 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":281,"threads_started":1}
I20260808 08:41:02.865397 29532 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35585
I20260808 08:41:02.865806 29532 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:02.866807 29532 heartbeater.cc:511] Master 127.19.242.254:35585 requested a full tablet report, sending...
I20260808 08:41:02.868618 29066 ts_manager.cc:194] Registered new tserver with Master: c4f56bcae994400c89614373615de47a (127.19.242.194:40985)
I20260808 08:41:02.869557 29066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:46727
WARNING: no policy specified for oryx/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab.
Entry for principal oryx/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab.
I20260808 08:41:02.914587 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35585
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab
--principal=oryx/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:03.283037 29539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:03.283445 29539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:03.283586 29539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:03.291745 29539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:03.291911 29539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:03.292112 29539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:03.297812 29331 heartbeater.cc:503] Master 127.19.242.254:35585 was elected leader, sending a full tablet report...
I20260808 08:41:03.303772 29539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab
--principal=oryx/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35585
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:03.305264 29539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:03.306820 29539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:03.322075 29546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:03.322000 29549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:03.322024 29551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:03.322973 29539 server_base.cc:1034] running on GCE node
I20260808 08:41:03.323626 29539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:03.324646 29539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:03.325933 29539 hybrid_clock.cc:648] HybridClock initialized: now 1786178463325872 us; error 57 us; skew 500 ppm
I20260808 08:41:03.326313 29539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:03 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178463, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:03.330099 29539 init.cc:377] Logged in from keytab as oryx/127.19.242.195@KRBTEST.COM (short username oryx)
I20260808 08:41:03.331878 29539 webserver.cc:460] Webserver started at http://127.19.242.195:37143/ using document root <none> and password file <none>
I20260808 08:41:03.332657 29539 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:03.332819 29539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:03.333158 29539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:03.336330 29539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "293082b145e34462951edfc51cf50f98"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "3ad00b8ba14d631e68368dedf3d2a475"
server_key_iv: "2dc11a6a3401587e6cd3620cd519ff07"
server_key_version: "encryptionkey@0"
I20260808 08:41:03.337204 29539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "293082b145e34462951edfc51cf50f98"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "3ad00b8ba14d631e68368dedf3d2a475"
server_key_iv: "2dc11a6a3401587e6cd3620cd519ff07"
server_key_version: "encryptionkey@0"
I20260808 08:41:03.343650 29539 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:41:03.347661 29561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:03.349498 29539 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:41:03.349762 29539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "293082b145e34462951edfc51cf50f98"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "3ad00b8ba14d631e68368dedf3d2a475"
server_key_iv: "2dc11a6a3401587e6cd3620cd519ff07"
server_key_version: "encryptionkey@0"
I20260808 08:41:03.350091 29539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:03.382005 29539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:03.387717 29539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:03.388091 29539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:03.389278 29539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:03.391253 29539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:03.391381 29539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:03.391566 29539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:03.391657 29539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:03.431730 29539 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:38867
I20260808 08:41:03.431766 29733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:38867 every 8 connection(s)
I20260808 08:41:03.433331 29539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:03.435231 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 29539
I20260808 08:41:03.435452 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:41:03.435956 20427 external_mini_cluster.cc:1428] Setting key 10fa21a18b674934421ca7c7d9f88e5f
Aug 08 08:41:03 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178463, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:03.456648 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:03.436418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:42371 (local address 127.19.242.254:35585)
0808 08:41:03.436939 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:03.436947 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:03.438426 (+ 1479us) server_negotiation.cc:407] Connection header received
0808 08:41:03.440545 (+ 2119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:03.440551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:03.440676 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:03.440800 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:03.442465 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:03.443334 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:03.444981 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:03.445397 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:03.445542 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:03.449443 (+ 3901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:03.449448 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:03.449451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:03.449490 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:03.452934 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:03.453805 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:03.453812 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:03.453815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:03.453953 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:03.454451 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:03.454456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:03.454459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:03.454870 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:03.455054 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:03.455981 (+ 927us) server_negotiation.cc:299] Negotiation successful
0808 08:41:03.456238 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":274,"threads_started":1}
I20260808 08:41:03.457724 29739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:03.437068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.195:42371)
0808 08:41:03.438159 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:03.438297 (+ 138us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:03.440248 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:03.441064 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:03.441074 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:03.441649 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:03.442273 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:03.442293 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:03.443515 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:03.443519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:03.444813 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:03.444833 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:03.445658 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:03.445666 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:03.445923 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:03.446641 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:03.446666 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:03.449156 (+ 2490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:03.453133 (+ 3977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:03.453147 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:03.453164 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:03.453665 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:03.454079 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:03.454084 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:03.454088 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:03.454316 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:03.455014 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:03.455025 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:03.455507 (+ 482us) client_negotiation.cc:769] Sending connection context
0808 08:41:03.455868 (+ 361us) client_negotiation.cc:240] Negotiation successful
0808 08:41:03.456500 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":425,"threads_started":1}
I20260808 08:41:03.459312 29734 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35585
I20260808 08:41:03.459663 29734 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:03.460500 29734 heartbeater.cc:511] Master 127.19.242.254:35585 requested a full tablet report, sending...
I20260808 08:41:03.462178 29066 ts_manager.cc:194] Registered new tserver with Master: 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867)
I20260808 08:41:03.463223 29066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:42371
I20260808 08:41:03.465427 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.253.keytab.
Entry for principal oryx/127.19.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.253.keytab.
I20260808 08:41:03.531484 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:45077
--webserver_interface=127.19.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.253.keytab
--principal=oryx/127.19.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:35585,127.19.242.253:45077
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:03.872538 29532 heartbeater.cc:503] Master 127.19.242.254:35585 was elected leader, sending a full tablet report...
W20260808 08:41:03.907269 29747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:03.907615 29747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:03.907711 29747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:03.915386 29747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:03.915539 29747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:03.915591 29747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:03.915642 29747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:03.915689 29747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:03.926371 29747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:35585,127.19.242.253:45077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.253.keytab
--principal=oryx/127.19.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:45077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
W20260808 08:41:03.926859 29747 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.242.254:35585,127.19.242.253:45077'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 08:41:03.927970 29747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:03.929339 29747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:03.942442 29753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:03.942480 29754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:03.942757 29757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:03.943476 29747 server_base.cc:1034] running on GCE node
I20260808 08:41:03.944372 29747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:03.945959 29747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:03.947229 29747 hybrid_clock.cc:648] HybridClock initialized: now 1786178463947155 us; error 52 us; skew 500 ppm
I20260808 08:41:03.947690 29747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:03 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178463, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:03.951684 29747 init.cc:377] Logged in from keytab as oryx/127.19.242.253@KRBTEST.COM (short username oryx)
I20260808 08:41:03.953431 29747 webserver.cc:460] Webserver started at http://127.19.242.253:37941/ using document root <none> and password file <none>
I20260808 08:41:03.954348 29747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:03.954499 29747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:03.954954 29747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:03.958307 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/instance:
uuid: "11d808a57d2b44da9ef49c4d53c5c2e3"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "420df503007245d91e99c83e1203b73e"
server_key_iv: "a48ded462f5dd7e455e60ffcce8db31f"
server_key_version: "encryptionkey@0"
I20260808 08:41:03.959195 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal/instance:
uuid: "11d808a57d2b44da9ef49c4d53c5c2e3"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "420df503007245d91e99c83e1203b73e"
server_key_iv: "a48ded462f5dd7e455e60ffcce8db31f"
server_key_version: "encryptionkey@0"
I20260808 08:41:03.965440 29747 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.005s
I20260808 08:41:03.969646 29771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:03.971597 29747 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 08:41:03.971841 29747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
uuid: "11d808a57d2b44da9ef49c4d53c5c2e3"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "420df503007245d91e99c83e1203b73e"
server_key_iv: "a48ded462f5dd7e455e60ffcce8db31f"
server_key_version: "encryptionkey@0"
I20260808 08:41:03.972149 29747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:03.996919 29747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:04.002328 29747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:04.002660 29747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:04.030157 29747 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.253:45077
I20260808 08:41:04.030151 29848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.253:45077 every 8 connection(s)
I20260808 08:41:04.031869 29747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
I20260808 08:41:04.035691 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 29747
I20260808 08:41:04.036233 29849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:04.047483 29849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.253@KRBTEST.COM
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178463, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.253@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:04.066066 29852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.038067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34704 (local address 127.19.242.253:45077)
0808 08:41:04.038929 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.038944 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.038990 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:41:04.041525 (+ 2535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.041563 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.042220 (+ 657us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.042787 (+ 567us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.045550 (+ 2763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.047048 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.049040 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.049805 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.049968 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.056109 (+ 6141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.056124 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.056159 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.056219 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.060385 (+ 4166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.061305 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.061314 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.061323 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.061648 (+ 325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.062202 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.062212 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.062216 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.063114 (+ 898us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.063436 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.063988 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.064532 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":340,"threads_started":1}
I20260808 08:41:04.072127 29856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.051198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49194 (local address 127.19.242.254:35585)
0808 08:41:04.051884 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.051893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.055763 (+ 3870us) server_negotiation.cc:407] Connection header received
0808 08:41:04.056020 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.056061 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.056174 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.056322 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.057786 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.058575 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.060298 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.060726 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.060889 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.065377 (+ 4488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.065383 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.065386 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.065431 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.068473 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.069831 (+ 1358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.069837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.069840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.070018 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.070458 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.070462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.070464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.070930 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.071062 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.071623 (+ 561us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.071849 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":315,"threads_started":1}
I20260808 08:41:04.072185 29857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.051191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49194)
0808 08:41:04.055517 (+ 4326us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.055591 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.055801 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.056389 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.056395 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.057257 (+ 862us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.057582 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.057593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.058764 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.058772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.060057 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.060078 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.060942 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.060948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.061154 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.061904 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.061934 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.065105 (+ 3171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.068694 (+ 3589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.068706 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.068713 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.069551 (+ 838us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.070141 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.070149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.070158 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.070324 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.071122 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.071129 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.071320 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.071512 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.071826 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4021,"thread_start_us":3833,"threads_started":1}
I20260808 08:41:04.074330 29849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178463, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.253@KRBTEST.COM for oryx/127.19.242.253@KRBTEST.COM
I20260808 08:41:04.089324 29857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.075270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.0.0.1:34720)
0808 08:41:04.075443 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.075463 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.075588 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.075913 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.075917 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.076345 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.076559 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.076568 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.077604 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.077611 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.078515 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.078527 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.079305 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.079311 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.079490 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.080188 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.080213 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.082815 (+ 2602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.086383 (+ 3568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.086390 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.086395 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.086950 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.087400 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.087405 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.087409 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.087559 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.088185 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.088191 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.088341 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.088513 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.088870 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:41:04.089427 29852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.075195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.19.242.253:45077)
0808 08:41:04.075422 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.075428 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.075514 (+ 86us) server_negotiation.cc:407] Connection header received
0808 08:41:04.075719 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.075723 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.075792 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.075896 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.076695 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.077421 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.078666 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.079133 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.079280 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.083050 (+ 3770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.083057 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.083064 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.083108 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.086196 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.087108 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.087119 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.087122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.087254 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.087684 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.087691 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.087694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.088024 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.088210 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.088618 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.089046 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":176,"server-negotiator.queue_time_us":63}
I20260808 08:41:04.095980 29849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Bootstrap starting.
I20260808 08:41:04.099771 29849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:04.101085 29849 log.cc:824] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:04.104651 29849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: No bootstrap required, opened a new log
I20260808 08:41:04.113335 29849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } }
I20260808 08:41:04.113842 29849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:04.113982 29849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d808a57d2b44da9ef49c4d53c5c2e3, State: Initialized, Role: FOLLOWER
I20260808 08:41:04.114869 29849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } }
I20260808 08:41:04.116127 29861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } } }
I20260808 08:41:04.116694 29861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:41:04.117420 29849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:41:04.127966 29878 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:41:04.128147 29878 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:41:04.132921 29747 master_runner.cc:428] Detected that this master 11d808a57d2b44da9ef49c4d53c5c2e3 is joining an existing cluster
I20260808 08:41:04.133041 29747 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.242.253:45077
I20260808 08:41:04.154762 29856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.137492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49198 (local address 127.19.242.254:35585)
0808 08:41:04.137698 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.137707 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.138581 (+ 874us) server_negotiation.cc:407] Connection header received
0808 08:41:04.138956 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.138965 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.139099 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.139217 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.140791 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.141860 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.143640 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.144238 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.144385 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.147332 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.147340 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.147345 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.147391 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.151354 (+ 3963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.152187 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.152194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.152198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.152404 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.152894 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.152900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.152903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.153293 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.153464 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.154118 (+ 654us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.154396 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:41:04.154824 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.137815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.0.0.1:34730)
0808 08:41:04.138836 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.138858 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.139006 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.139446 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.139454 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.140085 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.140425 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.140435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.141967 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.141974 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.143862 (+ 1888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.143878 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.144952 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.144958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.145162 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.145791 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.145813 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.146829 (+ 1016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.151471 (+ 4642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.151478 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.151483 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.152248 (+ 765us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.152733 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.152739 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.152743 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.152933 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.153564 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.153574 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.153731 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.153893 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.154261 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":820,"mutex_wait_us":4,"thread_start_us":583,"threads_started":1}
I20260808 08:41:04.155444 29852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.137354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34730 (local address 127.19.242.253:45077)
0808 08:41:04.137605 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.137615 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.138951 (+ 1336us) server_negotiation.cc:407] Connection header received
0808 08:41:04.139156 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.139163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.139248 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.139336 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.140588 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.141752 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.144035 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.144745 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.144900 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.147036 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.147040 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.147043 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.147073 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.151240 (+ 4167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.152408 (+ 1168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.152414 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.152417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.152611 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.153074 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.153080 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.153083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.153444 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.153643 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.154075 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.154438 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":61}
I20260808 08:41:04.155957 29888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.137442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49198)
0808 08:41:04.138415 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.138450 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.138763 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.139275 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.139280 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.140130 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.140594 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.140607 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.141978 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.141984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.143437 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.143453 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.144475 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.144483 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.144690 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.145644 (+ 954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.145671 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.147102 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.151523 (+ 4421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.151526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.151529 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.152017 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.152538 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.152543 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.152547 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.152743 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.153422 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.153427 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.153686 (+ 259us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.155078 (+ 1392us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.155466 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":89,"spinlock_wait_cycles":39168,"thread_start_us":513,"threads_started":1}
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178461, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.254@KRBTEST.COM for oryx/127.19.242.253@KRBTEST.COM
I20260808 08:41:04.184114 29852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.165161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34740 (local address 127.19.242.253:45077)
0808 08:41:04.165413 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.165422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.165746 (+ 324us) server_negotiation.cc:407] Connection header received
0808 08:41:04.166109 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.166113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.166229 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.166350 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.167719 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.168483 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.170029 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.170806 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.170948 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.175403 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.175413 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.175420 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.175470 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.179920 (+ 4450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.181192 (+ 1272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.181199 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.181203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.181397 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.182155 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.182160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.182164 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.182554 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.182763 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.183423 (+ 660us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.183718 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:41:04.184471 29890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.164792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.0.0.1:34740)
0808 08:41:04.165594 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.165641 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.165866 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.166409 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.166417 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.167296 (+ 879us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.167532 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.167542 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.168654 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.168660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.169813 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.169827 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.170990 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.170995 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.171178 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.172068 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.172098 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.175128 (+ 3030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.180122 (+ 4994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.180147 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.180160 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.180960 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.181614 (+ 654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.181622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.181628 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.181889 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.182757 (+ 868us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.182770 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.183032 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.183297 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.183747 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":438,"threads_started":1}
I20260808 08:41:04.187244 29066 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.242.253:45077: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3"
member_type: NON_VOTER
last_known_addr {
host: "127.19.242.253"
port: 45077
}
attrs {
promote: true
}
}
dest_uuid: "fc5386c578ab40328a4c15e4bad3a9f0"
cas_config_opid_index: -1
I20260808 08:41:04.188660 29066 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } }
I20260808 08:41:04.200350 29817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:04.202392 29893 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 11d808a57d2b44da9ef49c4d53c5c2e3 (127.19.242.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.204622 29817 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Refusing update from remote peer fc5386c578ab40328a4c15e4bad3a9f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 08:41:04.208267 29895 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:04.211570 29893 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.242.253:45077
I20260808 08:41:04.212664 29747 master.cc:537] Master@127.19.242.253:45077 shutting down...
WARNING: no policy specified for oryx/127.19.242.252@KRBTEST.COM; defaulting to no policy
I20260808 08:41:04.213387 29896 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.213801 29896 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.252.keytab.
Entry for principal oryx/127.19.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.252.keytab.
I20260808 08:41:04.252152 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:35639
--webserver_interface=127.19.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.252.keytab
--principal=oryx/127.19.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:04.267381 29817 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 11d808a57d2b44da9ef49c4d53c5c2e3 (127.19.242.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.274631 29861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc5386c578ab40328a4c15e4bad3a9f0. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.275092 29861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:41:04.275130 29907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.275485 29907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:41:04.277455 29912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.278661 29912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:41:04.278842 29747 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 LEARNER]: Raft consensus shutting down.
I20260808 08:41:04.279445 29747 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 LEARNER]: Raft consensus is shut down!
I20260808 08:41:04.279695 29747 tablet_replica.cc:330] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: stopping tablet replica
I20260808 08:41:04.289654 29747 master.cc:552] Master@127.19.242.253:45077 shutdown complete.
I20260808 08:41:04.289829 29747 master_runner.cc:305] Clearing existing system tablet
I20260808 08:41:04.290387 29747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:04.290556 29747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:04.294266 29747 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:41:04.296417 29914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:04.296839 29747 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:04.297171 29747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:41:04.297271 29747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
uuid: "11d808a57d2b44da9ef49c4d53c5c2e3"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "420df503007245d91e99c83e1203b73e"
server_key_iv: "a48ded462f5dd7e455e60ffcce8db31f"
server_key_version: "encryptionkey@0"
I20260808 08:41:04.303215 29747 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:04.311661 29747 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:41:04.311914 29747 log.cc:1196] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 08:41:04.312613 29747 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Deleting consensus metadata
I20260808 08:41:04.312944 29747 master_runner.cc:315] Copying system tablet from 127.19.242.254:35585
I20260808 08:41:04.316757 29747 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: tablet copy: Beginning tablet copy session from remote peer at address 127.19.242.254:35585
I20260808 08:41:04.340569 29856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.318105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49200 (local address 127.19.242.254:35585)
0808 08:41:04.318326 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.318333 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.323686 (+ 5353us) server_negotiation.cc:407] Connection header received
0808 08:41:04.323946 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.323953 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.324051 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.324199 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.325440 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.326655 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.328869 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.329792 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.329972 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.332754 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.332761 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.332765 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.332814 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.336861 (+ 4047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.337883 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.337889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.337893 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.338065 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.338543 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.338548 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.338551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.338977 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.339139 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.339825 (+ 686us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.340118 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:41:04.340649 29922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.318053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49200)
0808 08:41:04.323320 (+ 5267us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.323348 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.323756 (+ 408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.324262 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.324268 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.324905 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.325229 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.325245 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.326887 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.326895 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.328652 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.328673 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.330008 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.330015 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.330264 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.331168 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.331199 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.332461 (+ 1262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.337059 (+ 4598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.337067 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.337072 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.337721 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.338202 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.338208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.338213 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.338401 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.339214 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.339219 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.339426 (+ 207us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.339764 (+ 338us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.340147 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5085,"thread_start_us":4915,"threads_started":1}
I20260808 08:41:04.342135 29094 tablet_copy_service.cc:140] P fc5386c578ab40328a4c15e4bad3a9f0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 11d808a57d2b44da9ef49c4d53c5c2e3 ({username='oryx', principal='oryx/127.19.242.253@KRBTEST.COM'} at 127.0.0.1:49200)
I20260808 08:41:04.342644 29094 tablet_copy_service.cc:161] P fc5386c578ab40328a4c15e4bad3a9f0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 11d808a57d2b44da9ef49c4d53c5c2e3 at {username='oryx', principal='oryx/127.19.242.253@KRBTEST.COM'} at 127.0.0.1:49200: session id = 11d808a57d2b44da9ef49c4d53c5c2e3-00000000000000000000000000000000
I20260808 08:41:04.348403 29094 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:41:04.351776 29747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:41:04.359596 29747 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: tablet copy: Starting download of 0 data blocks...
I20260808 08:41:04.360106 29747 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: tablet copy: Starting download of 1 WAL segments...
I20260808 08:41:04.364606 29747 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:41:04.370540 29094 tablet_copy_service.cc:342] P fc5386c578ab40328a4c15e4bad3a9f0: Request end of tablet copy session 11d808a57d2b44da9ef49c4d53c5c2e3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.242.253@KRBTEST.COM'} at 127.0.0.1:49200
I20260808 08:41:04.370934 29094 tablet_copy_service.cc:433] P fc5386c578ab40328a4c15e4bad3a9f0: ending tablet copy session 11d808a57d2b44da9ef49c4d53c5c2e3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 11d808a57d2b44da9ef49c4d53c5c2e3
I20260808 08:41:04.384760 29747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:04.387945 29923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:04.389417 29924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:04.395783 29747 server_base.cc:1034] running on GCE node
W20260808 08:41:04.396329 29930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:04.396989 29747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:04.397879 29747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:04.399284 29747 hybrid_clock.cc:648] HybridClock initialized: now 1786178464399206 us; error 57 us; skew 500 ppm
I20260808 08:41:04.399658 29747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:04.402279 29747 init.cc:377] Logged in from keytab as oryx/127.19.242.253@KRBTEST.COM (short username oryx)
I20260808 08:41:04.407442 29747 webserver.cc:460] Webserver started at http://127.19.242.253:46019/ using document root <none> and password file <none>
I20260808 08:41:04.407904 29747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:04.408012 29747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:04.412041 29747 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:04.414565 29937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:04.415149 29747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 08:41:04.415311 29747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
uuid: "11d808a57d2b44da9ef49c4d53c5c2e3"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "420df503007245d91e99c83e1203b73e"
server_key_iv: "a48ded462f5dd7e455e60ffcce8db31f"
server_key_version: "encryptionkey@0"
I20260808 08:41:04.415521 29747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:04.433835 29747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:04.439172 29747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:04.466694 29734 heartbeater.cc:503] Master 127.19.242.254:35585 was elected leader, sending a full tablet report...
I20260808 08:41:04.472816 29747 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.253:45077
I20260808 08:41:04.472846 30013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.253:45077 every 8 connection(s)
I20260808 08:41:04.473982 29747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
I20260808 08:41:04.480224 30017 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:41:04.485165 30017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Bootstrap starting.
I20260808 08:41:04.504119 30017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:41:04.504798 30017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Bootstrap complete.
I20260808 08:41:04.506017 30017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } }
I20260808 08:41:04.506325 30017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 11d808a57d2b44da9ef49c4d53c5c2e3, State: Initialized, Role: LEARNER
I20260808 08:41:04.506760 30017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } }
I20260808 08:41:04.508258 30017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:04.508100 30021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.508646 30021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:41:04.519268 30036 catalog_manager.cc:1259] Loaded cluster ID: 393093ccd3814d2c97b2e402dbbd8458
I20260808 08:41:04.519421 30036 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: loading cluster ID for follower catalog manager: success
I20260808 08:41:04.523904 30036 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: acquiring CA information for follower catalog manager: success
I20260808 08:41:04.527346 30036 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:41:04.671550 29893 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.671891 29893 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:04.684855 29890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.672136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.0.0.1:34754)
0808 08:41:04.672367 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.672391 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.672559 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.674061 (+ 1502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.674076 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.674139 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:04.674531 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.674564 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.676552 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.676560 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.680695 (+ 4135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.680775 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.683528 (+ 2753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.683538 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.683973 (+ 435us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.684075 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.684256 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.684484 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 08:41:04.684931 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.672750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34754 (local address 127.19.242.253:45077)
0808 08:41:04.673497 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.673504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.673531 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:41:04.673611 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.673617 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.673735 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.673886 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:04.674852 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.676293 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.681140 (+ 4847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.683202 (+ 2062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.683469 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.683692 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.684287 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.684446 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":393,"threads_started":1}
I20260808 08:41:04.686908 30021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc5386c578ab40328a4c15e4bad3a9f0. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: NON_VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: true } } }
I20260808 08:41:04.687345 30021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:41:04.688519 29894 raft_consensus.cc:1050] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: attempting to promote NON_VOTER 11d808a57d2b44da9ef49c4d53c5c2e3 to VOTER
I20260808 08:41:04.689673 29894 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } }
I20260808 08:41:04.692524 29967 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 LEARNER]: Refusing update from remote peer fc5386c578ab40328a4c15e4bad3a9f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 08:41:04.693483 29893 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 08:41:04.698189 29894 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 11d808a57d2b44da9ef49c4d53c5c2e3 (127.19.242.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } }
I20260808 08:41:04.699349 29967 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 11d808a57d2b44da9ef49c4d53c5c2e3 (127.19.242.253) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } }
I20260808 08:41:04.703809 30021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } }
I20260808 08:41:04.704154 30021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:41:04.704849 29893 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } }
I20260808 08:41:04.705243 29893 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:04.705359 29896 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } }
I20260808 08:41:04.705593 29896 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
W20260808 08:41:04.738914 29911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:04.739598 29911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:04.739801 29911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:04.749394 29911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:04.749645 29911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:04.749912 29911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:04.750105 29911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:04.750216 29911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:04.764792 29911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.252.keytab
--principal=oryx/127.19.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:35639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:04.766436 29911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:04.768455 29911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:04.791356 30044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:04.792049 30047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:04.792317 30051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:04.793699 29911 server_base.cc:1034] running on GCE node
I20260808 08:41:04.795008 29911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:04.796885 29911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:04.798261 29911 hybrid_clock.cc:648] HybridClock initialized: now 1786178464798119 us; error 47 us; skew 500 ppm
I20260808 08:41:04.798830 29911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:04.804404 29911 init.cc:377] Logged in from keytab as oryx/127.19.242.252@KRBTEST.COM (short username oryx)
I20260808 08:41:04.807191 29911 webserver.cc:460] Webserver started at http://127.19.242.252:32845/ using document root <none> and password file <none>
I20260808 08:41:04.808228 29911 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:04.808501 29911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:04.809047 29911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:04.813905 29911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/instance:
uuid: "8adabf39b3464902b9752bfe5ad40e68"
format_stamp: "Formatted at 2026-08-08 08:41:04 on dist-test-slave-39l8"
server_key: "0aaf5a39f61f841e045e6ed97690957f"
server_key_iv: "6e1da98405da4c0fa083c58836976a40"
server_key_version: "encryptionkey@0"
I20260808 08:41:04.815212 29911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal/instance:
uuid: "8adabf39b3464902b9752bfe5ad40e68"
format_stamp: "Formatted at 2026-08-08 08:41:04 on dist-test-slave-39l8"
server_key: "0aaf5a39f61f841e045e6ed97690957f"
server_key_iv: "6e1da98405da4c0fa083c58836976a40"
server_key_version: "encryptionkey@0"
I20260808 08:41:04.823920 29911 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260808 08:41:04.829490 30061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:04.831370 29911 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:41:04.831600 29911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
uuid: "8adabf39b3464902b9752bfe5ad40e68"
format_stamp: "Formatted at 2026-08-08 08:41:04 on dist-test-slave-39l8"
server_key: "0aaf5a39f61f841e045e6ed97690957f"
server_key_iv: "6e1da98405da4c0fa083c58836976a40"
server_key_version: "encryptionkey@0"
I20260808 08:41:04.831843 29911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:04.847041 29911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:04.852370 29911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:04.852734 29911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:04.894117 29911 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.252:35639
I20260808 08:41:04.894217 30127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.252:35639 every 8 connection(s)
I20260808 08:41:04.896390 29911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
I20260808 08:41:04.897286 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 29911
I20260808 08:41:04.903913 30128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:04.919394 30128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.252@KRBTEST.COM
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.252@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:04.938319 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.901113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43950 (local address 127.19.242.252:35639)
0808 08:41:04.902870 (+ 1757us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.902888 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.902972 (+ 84us) server_negotiation.cc:407] Connection header received
0808 08:41:04.907364 (+ 4392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.907402 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.908180 (+ 778us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.908885 (+ 705us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.911585 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.915707 (+ 4122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.917493 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.918556 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.918838 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.927528 (+ 8690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.927540 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.927556 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.927663 (+ 107us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.932101 (+ 4438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.933243 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.933263 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.933271 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.933549 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.934342 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.934346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.934348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.935046 (+ 698us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.935728 (+ 682us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.936356 (+ 628us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.936944 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1379,"thread_start_us":924,"threads_started":1}
I20260808 08:41:04.945628 30133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.923773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49212)
0808 08:41:04.926103 (+ 2330us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.926243 (+ 140us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.926636 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.927366 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.927375 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.928443 (+ 1068us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.928763 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.928775 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.930214 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.930227 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.931638 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.931653 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.932754 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.932760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.933057 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.934118 (+ 1061us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.934148 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.937575 (+ 3427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.942337 (+ 4762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.942348 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.942353 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.942965 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.943540 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.943543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.943546 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.943812 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.944542 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.944549 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.944746 (+ 197us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.944922 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.945297 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1941,"thread_start_us":1569,"threads_started":1}
I20260808 08:41:04.945688 30132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.923731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49212 (local address 127.19.242.254:35585)
0808 08:41:04.924745 (+ 1014us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.924750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.926383 (+ 1633us) server_negotiation.cc:407] Connection header received
0808 08:41:04.926924 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.926929 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.927096 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.927249 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.928956 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.930026 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.931842 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.932530 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.932713 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.937827 (+ 5114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.937834 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.937837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.937878 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.942152 (+ 4274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.943159 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.943167 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.943170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.943371 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.944050 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.944055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.944057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.944374 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.944510 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.945064 (+ 554us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.945356 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":899,"thread_start_us":688,"threads_started":1}
I20260808 08:41:04.947453 30128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.252@KRBTEST.COM for oryx/127.19.242.253@KRBTEST.COM
I20260808 08:41:04.964962 30133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.948812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.0.0.1:34768)
0808 08:41:04.949279 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.949295 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.949524 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.949953 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.949958 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.950410 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.950575 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.950586 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.951952 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.951958 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.952940 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.952954 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.953757 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.953764 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.953973 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.954659 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.954690 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.957425 (+ 2735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.961525 (+ 4100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.961530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.961533 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.962360 (+ 827us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.963041 (+ 681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.963045 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.963048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.963264 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.963929 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.963933 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.964101 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.964294 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.964659 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260808 08:41:04.965054 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.948731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34768 (local address 127.19.242.253:45077)
0808 08:41:04.949202 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.949210 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.949433 (+ 223us) server_negotiation.cc:407] Connection header received
0808 08:41:04.949716 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.949720 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.949801 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.949922 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.950968 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.951771 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.953117 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.953553 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.953711 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.957763 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.957770 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.957774 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.957823 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.961176 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.962533 (+ 1357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.962539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.962541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.962822 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.963432 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.963437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.963439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.963775 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.963914 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.964446 (+ 532us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.964747 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309}
I20260808 08:41:04.966894 30128 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:41:04 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178464, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.252@KRBTEST.COM for oryx/127.19.242.252@KRBTEST.COM
I20260808 08:41:04.981773 30133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.967695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.0.0.1:43962)
0808 08:41:04.967936 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:04.967963 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:04.968090 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:04.968391 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:04.968394 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:04.968799 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:04.968961 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.968970 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.970099 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.970104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.971240 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:04.971255 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.972012 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.972017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:04.972232 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.972877 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:04.972896 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:04.975294 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:04.979162 (+ 3868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.979166 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.979169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.979586 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.980061 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:04.980065 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:04.980067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:04.980223 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:04.980891 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:04.980896 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:04.981048 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 08:41:04.981165 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 08:41:04.981389 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:41:04.982029 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:04.967976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43962 (local address 127.19.242.252:35639)
0808 08:41:04.968140 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:04.968145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:04.968162 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:41:04.968206 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:04.968209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:04.968266 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:04.968350 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:04.969101 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.969929 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.971414 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:04.971841 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:04.971952 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:04.975577 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:04.975590 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:04.975594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:04.975640 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:04.978976 (+ 3336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.979740 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.979744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.979746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.979942 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:04.980435 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:04.980439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:04.980441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:04.980750 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:04.980899 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:04.981275 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 08:41:04.981630 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":62}
I20260808 08:41:04.987313 30128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Bootstrap starting.
I20260808 08:41:04.991358 30128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:04.992697 30128 log.cc:824] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:04.995931 30128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: No bootstrap required, opened a new log
I20260808 08:41:05.003888 30128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } }
I20260808 08:41:05.004287 30128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:05.004442 30128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8adabf39b3464902b9752bfe5ad40e68, State: Initialized, Role: FOLLOWER
I20260808 08:41:05.005103 30128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } }
I20260808 08:41:05.006232 30135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } } }
I20260808 08:41:05.006752 30135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:41:05.007368 30128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:41:05.019207 30151 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:41:05.019407 30151 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:41:05.024793 29911 master_runner.cc:428] Detected that this master 8adabf39b3464902b9752bfe5ad40e68 is joining an existing cluster
I20260808 08:41:05.024928 29911 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.242.252:35639
I20260808 08:41:05.049309 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 29148
I20260808 08:41:05.057863 30132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.030101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49228 (local address 127.19.242.254:35585)
0808 08:41:05.030344 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.030353 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.031500 (+ 1147us) server_negotiation.cc:407] Connection header received
0808 08:41:05.031884 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.031893 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.032024 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.032125 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.034379 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.036153 (+ 1774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.039329 (+ 3176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.040343 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.040491 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.044575 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.044586 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.044594 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.044658 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.050966 (+ 6308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.053000 (+ 2034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.053013 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.053019 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.053382 (+ 363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.055756 (+ 2374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.055763 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.055766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.056214 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.056386 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.057199 (+ 813us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.057492 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:41:05.059098 30165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.030539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49228)
0808 08:41:05.031341 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.031374 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.031672 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.032448 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.032455 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.033469 (+ 1014us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.034066 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.034091 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.036516 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.036526 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.039021 (+ 2495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.039048 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.040946 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.040956 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.041257 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.042331 (+ 1074us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.042373 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.044212 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.051321 (+ 7109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.051330 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.051337 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.052373 (+ 1036us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.053653 (+ 1280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.053662 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.053667 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.055583 (+ 1916us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.056486 (+ 903us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.056491 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.056763 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.058112 (+ 1349us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.058516 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":420,"threads_started":1}
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.193@KRBTEST.COM
I20260808 08:41:05.071936 30169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.031056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.0.0.1:34780)
0808 08:41:05.043702 (+ 12646us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.043727 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.043954 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.044666 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.044671 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.045456 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.045857 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.045873 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.054992 (+ 9119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.054999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.056978 (+ 1979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.056995 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.058840 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.058849 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.059049 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.059874 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.059897 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.061243 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.066775 (+ 5532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.066781 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.066788 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.067430 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.067992 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.067998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.068002 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.068792 (+ 790us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.070055 (+ 1263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.070063 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.070396 (+ 333us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.070664 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.071227 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12452,"thread_start_us":22463,"threads_started":1}
I20260808 08:41:05.073204 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.030270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34780 (local address 127.19.242.253:45077)
0808 08:41:05.030463 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.030468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.043836 (+ 13368us) server_negotiation.cc:407] Connection header received
0808 08:41:05.044137 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.044143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.044306 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.044408 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.053187 (+ 8779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.054650 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.057603 (+ 2953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.058391 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.058530 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.061533 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.061542 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.061547 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.061597 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.066518 (+ 4921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.067621 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.067629 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.067635 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.067825 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.069058 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.069063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.069067 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.069740 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.069952 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.072506 (+ 2554us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.072818 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178461, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.254@KRBTEST.COM for oryx/127.19.242.252@KRBTEST.COM
I20260808 08:41:05.083412 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.051608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34354 (local address 127.19.242.193:32907)
0808 08:41:05.054731 (+ 3123us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.054742 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.054777 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:41:05.054862 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.054871 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.055240 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.057431 (+ 2191us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.057701 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.061300 (+ 3599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.063900 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.065144 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.068344 (+ 3200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.073543 (+ 5199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.073566 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.073590 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.073654 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.078818 (+ 5164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.080012 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.080042 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.080048 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.080332 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.080915 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.080920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.080923 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.081397 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.081711 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.082552 (+ 841us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.082917 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2854,"thread_start_us":2439,"threads_started":1}
I20260808 08:41:05.085321 29326 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:05.089684 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.031655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43968 (local address 127.19.242.252:35639)
0808 08:41:05.031832 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.031839 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.057144 (+ 25305us) server_negotiation.cc:407] Connection header received
0808 08:41:05.057189 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.057193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.057299 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.057391 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.069691 (+ 12300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.070991 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.074111 (+ 3120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.075011 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.075113 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.078189 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.078198 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.078202 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.078247 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.085110 (+ 6863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.086179 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.086185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.086191 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.086385 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.086956 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.086962 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.086964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.087433 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.087624 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.088863 (+ 1239us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.089142 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:41:05.092206 30167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.031838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.0.0.1:43968)
0808 08:41:05.054821 (+ 22983us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.054849 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.055119 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.059536 (+ 4417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.059541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.068988 (+ 9447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.069518 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.069536 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.071243 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.071249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.073250 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.073260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.075544 (+ 2284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.075551 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.075797 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.076555 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.076591 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.077953 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.085298 (+ 7345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.085304 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.085308 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.086049 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.086531 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.086538 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.086545 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.086741 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.087724 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.087730 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.087939 (+ 209us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.090079 (+ 2140us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.090425 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22804,"thread_start_us":21827,"threads_started":1}
I20260808 08:41:05.095322 29890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.066959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.0.0.1:43978)
0808 08:41:05.067315 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.067338 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.067488 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.073774 (+ 6286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.073780 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.074321 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.074601 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.074620 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.076951 (+ 2331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.076958 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.078530 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.078553 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.079897 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.079907 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.080096 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.080776 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.080807 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.085699 (+ 4892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.091584 (+ 5885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.091594 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.091601 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.092254 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.093043 (+ 789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.093051 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.093057 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.093259 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.094050 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.094056 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.094278 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.094426 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.094792 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218}
I20260808 08:41:05.096166 30173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.069189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43978 (local address 127.19.242.252:35639)
0808 08:41:05.073019 (+ 3830us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.073025 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.073053 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:41:05.073169 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.073175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.073551 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.073679 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.074871 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.076719 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.078801 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.079676 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.080501 (+ 825us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.086064 (+ 5563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.086071 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.086078 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.086123 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.091365 (+ 5242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.092659 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.092664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.092667 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.092866 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.093421 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.093426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.093430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.093911 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.094892 (+ 981us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.095045 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.095320 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3577,"thread_start_us":3351,"threads_started":1}
I20260808 08:41:05.097844 29066 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.242.252:35639: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68"
member_type: NON_VOTER
last_known_addr {
host: "127.19.242.252"
port: 35639
}
attrs {
promote: true
}
}
dest_uuid: "fc5386c578ab40328a4c15e4bad3a9f0"
cas_config_opid_index: 6
I20260808 08:41:05.098788 29066 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } }
I20260808 08:41:05.101389 29967 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Refusing update from remote peer fc5386c578ab40328a4c15e4bad3a9f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 08:41:05.101540 30096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:05.102160 29896 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 08:41:05.105429 29893 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:05.106170 29967 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:05.111259 29893 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.242.252:35639
I20260808 08:41:05.111107 30021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:05.111531 30021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:41:05.112435 29894 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:05.112789 29894 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:05.113147 29894 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:05.113425 29894 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
W20260808 08:41:05.127131 30070 tablet.cc:2369] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:41:05.127372 30096 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Refusing update from remote peer fc5386c578ab40328a4c15e4bad3a9f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 08:41:05.128499 29911 master.cc:537] Master@127.19.242.252:35639 shutting down...
I20260808 08:41:05.128545 29894 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:41:05.132637 29044 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260808 08:41:05.147341 29911 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:05.148159 29911 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:05.148579 29911 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: stopping tablet replica
W20260808 08:41:05.151039 29044 consensus_peers.cc:487] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 -> Peer 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252:35639): Couldn't send request to peer 8adabf39b3464902b9752bfe5ad40e68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 08:41:05.157258 29911 master.cc:552] Master@127.19.242.252:35639 shutdown complete.
I20260808 08:41:05.157371 29911 master_runner.cc:305] Clearing existing system tablet
I20260808 08:41:05.157788 29911 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:05.157908 29911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:05.161298 29911 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260808 08:41:05.163568 30177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:05.164081 29911 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:05.164433 29911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 08:41:05.164606 29911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
uuid: "8adabf39b3464902b9752bfe5ad40e68"
format_stamp: "Formatted at 2026-08-08 08:41:04 on dist-test-slave-39l8"
server_key: "0aaf5a39f61f841e045e6ed97690957f"
server_key_iv: "6e1da98405da4c0fa083c58836976a40"
server_key_version: "encryptionkey@0"
I20260808 08:41:05.170331 29911 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:05.178326 29911 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:41:05.178622 29911 log.cc:1196] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 08:41:05.179283 29911 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Deleting consensus metadata
I20260808 08:41:05.179642 29911 master_runner.cc:315] Copying system tablet from 127.19.242.254:35585
I20260808 08:41:05.182816 29911 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: tablet copy: Beginning tablet copy session from remote peer at address 127.19.242.254:35585
I20260808 08:41:05.205286 30132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.183836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49244 (local address 127.19.242.254:35585)
0808 08:41:05.184052 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.184062 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.187429 (+ 3367us) server_negotiation.cc:407] Connection header received
0808 08:41:05.187641 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.187647 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.187762 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.187900 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.189184 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.190374 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.192805 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.193651 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.193783 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.197188 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.197196 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.197202 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.197250 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.201484 (+ 4234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.202640 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.202647 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.202651 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.202870 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.203444 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.203449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.203452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.203848 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.204008 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.204589 (+ 581us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.204864 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:41:05.205822 30186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.183728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49244)
0808 08:41:05.187229 (+ 3501us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.187267 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.187479 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.187967 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.187973 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.188616 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.188941 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.188957 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.190629 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.190637 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.192579 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.192601 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.194060 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.194068 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.194414 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.195387 (+ 973us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.195416 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.196845 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.201718 (+ 4873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.201725 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.201729 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.202433 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.203025 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.203032 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.203046 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.203280 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.204000 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.204007 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.204242 (+ 235us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.204410 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.204821 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3321,"thread_start_us":3179,"threads_started":1}
I20260808 08:41:05.206553 29094 tablet_copy_service.cc:140] P fc5386c578ab40328a4c15e4bad3a9f0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8adabf39b3464902b9752bfe5ad40e68 ({username='oryx', principal='oryx/127.19.242.252@KRBTEST.COM'} at 127.0.0.1:49244)
I20260808 08:41:05.206779 29094 tablet_copy_service.cc:161] P fc5386c578ab40328a4c15e4bad3a9f0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8adabf39b3464902b9752bfe5ad40e68 at {username='oryx', principal='oryx/127.19.242.252@KRBTEST.COM'} at 127.0.0.1:49244: session id = 8adabf39b3464902b9752bfe5ad40e68-00000000000000000000000000000000
I20260808 08:41:05.210602 29094 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:41:05.214814 29911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:41:05.216430 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 29148
I20260808 08:41:05.226518 29911 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: tablet copy: Starting download of 0 data blocks...
I20260808 08:41:05.227123 29911 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: tablet copy: Starting download of 1 WAL segments...
I20260808 08:41:05.234122 29911 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:41:05.240329 29094 tablet_copy_service.cc:342] P fc5386c578ab40328a4c15e4bad3a9f0: Request end of tablet copy session 8adabf39b3464902b9752bfe5ad40e68-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.242.252@KRBTEST.COM'} at 127.0.0.1:49244
I20260808 08:41:05.240530 29094 tablet_copy_service.cc:433] P fc5386c578ab40328a4c15e4bad3a9f0: ending tablet copy session 8adabf39b3464902b9752bfe5ad40e68-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8adabf39b3464902b9752bfe5ad40e68
I20260808 08:41:05.251590 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:32907
--local_ip_for_outbound_sockets=127.19.242.193
--tserver_master_addrs=127.19.242.254:35585
--webserver_port=38825
--webserver_interface=127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab
--principal=oryx/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:05.255219 29911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:05.259178 30188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:05.261137 30189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:05.265767 30193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:05.266815 29911 server_base.cc:1034] running on GCE node
I20260808 08:41:05.267217 29911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:05.268771 29911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:05.270000 29911 hybrid_clock.cc:648] HybridClock initialized: now 1786178465269948 us; error 41 us; skew 500 ppm
I20260808 08:41:05.270299 29911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178465, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:05.272768 29911 init.cc:377] Logged in from keytab as oryx/127.19.242.252@KRBTEST.COM (short username oryx)
I20260808 08:41:05.275862 29911 webserver.cc:460] Webserver started at http://127.19.242.252:34425/ using document root <none> and password file <none>
I20260808 08:41:05.276262 29911 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:05.276376 29911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:05.279901 29911 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 08:41:05.282287 30207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:05.282871 29911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 08:41:05.283016 29911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
uuid: "8adabf39b3464902b9752bfe5ad40e68"
format_stamp: "Formatted at 2026-08-08 08:41:04 on dist-test-slave-39l8"
server_key: "0aaf5a39f61f841e045e6ed97690957f"
server_key_iv: "6e1da98405da4c0fa083c58836976a40"
server_key_version: "encryptionkey@0"
I20260808 08:41:05.283257 29911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:05.316020 29911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:05.320803 29911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:05.353319 29911 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.252:35639
I20260808 08:41:05.353382 30281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.252:35639 every 8 connection(s)
I20260808 08:41:05.354449 29911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
I20260808 08:41:05.360460 30283 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:41:05.364532 30283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Bootstrap starting.
I20260808 08:41:05.392516 30283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:41:05.393114 30283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: Bootstrap complete.
I20260808 08:41:05.394765 30283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } }
I20260808 08:41:05.395119 30283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8adabf39b3464902b9752bfe5ad40e68, State: Initialized, Role: LEARNER
I20260808 08:41:05.395387 30283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } }
I20260808 08:41:05.396644 30283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:05.396366 30289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:05.396963 30289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: This master's current role is: LEARNER
I20260808 08:41:05.405032 30309 catalog_manager.cc:1259] Loaded cluster ID: 393093ccd3814d2c97b2e402dbbd8458
I20260808 08:41:05.405257 30309 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: loading cluster ID for follower catalog manager: success
I20260808 08:41:05.409214 30309 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: acquiring CA information for follower catalog manager: success
I20260808 08:41:05.412065 30309 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:41:05.573347 29890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.563795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.0.0.1:43992)
0808 08:41:05.564074 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.564097 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.564231 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.565246 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.565254 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.565299 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:05.565540 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.565554 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.567914 (+ 2360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.567921 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.570240 (+ 2319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.570268 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.572307 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.572315 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.572602 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.572665 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.572806 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.573002 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153}
I20260808 08:41:05.573391 30310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.564032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43992 (local address 127.19.242.252:35639)
0808 08:41:05.564821 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.564828 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.564848 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:41:05.564929 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.564933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.565022 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.565163 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:05.565791 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.567707 (+ 1916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.570471 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.572013 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.572250 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.572454 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.572844 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.573001 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":434,"threads_started":1}
I20260808 08:41:05.575501 30245 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.7] Dedup: 1.7->[]
I20260808 08:41:05.576216 30289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc5386c578ab40328a4c15e4bad3a9f0. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:05.576594 30289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: This master's current role is: LEARNER
W20260808 08:41:05.683748 30197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:05.684211 30197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:05.684420 30197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:05.692818 30197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:05.692967 30197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:05.693091 30197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:05.704311 30197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab
--principal=oryx/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:32907
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=38825
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:05.705888 30197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:05.707540 30197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:05.724668 30317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:05.724640 30322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:05.724751 30320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:05.728706 30197 server_base.cc:1034] running on GCE node
I20260808 08:41:05.729552 30197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:05.730854 30197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:05.732172 30197 hybrid_clock.cc:648] HybridClock initialized: now 1786178465732118 us; error 45 us; skew 500 ppm
I20260808 08:41:05.732565 30197 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178465, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:05.742659 30197 init.cc:377] Logged in from keytab as oryx/127.19.242.193@KRBTEST.COM (short username oryx)
I20260808 08:41:05.744858 30197 webserver.cc:460] Webserver started at http://127.19.242.193:38825/ using document root <none> and password file <none>
I20260808 08:41:05.745707 30197 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:05.745883 30197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:05.752645 30197 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 08:41:05.756510 30330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:05.758203 30197 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:41:05.758496 30197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "9e63794ec66c43b0ae08bdffd18aaf5b"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "bbd4f36584b5a837c4251eb4960c7dc0"
server_key_iv: "8f0602ea4de0f14e775aa2174eac2a45"
server_key_version: "encryptionkey@0"
I20260808 08:41:05.759840 30197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:05.775163 30197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:05.780579 30197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:05.780969 30197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:05.782382 30197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:05.784299 30197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:05.784436 30197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:05.784576 30197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:05.784665 30197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:05.829217 30197 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:32907
I20260808 08:41:05.829355 30507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:32907 every 8 connection(s)
I20260808 08:41:05.830865 30197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:05.839802 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 30197
I20260808 08:41:05.840209 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 29337
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178465, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.252@KRBTEST.COM
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178465, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178465, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.253@KRBTEST.COM
Aug 08 08:41:05 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.194@KRBTEST.COM
I20260808 08:41:05.866142 30310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.840016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:38447 (local address 127.19.242.252:35639)
0808 08:41:05.840378 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.840384 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.841102 (+ 718us) server_negotiation.cc:407] Connection header received
0808 08:41:05.841377 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.841382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.841458 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.841555 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.846047 (+ 4492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.846910 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.849307 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.850032 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.850140 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.856474 (+ 6334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.856483 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.856489 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.856541 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.861341 (+ 4800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.862539 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.862545 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.862549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.862817 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.863465 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.863474 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.863476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.863991 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.864137 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.865478 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.865742 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 08:41:05.866142 30517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.834908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:38311 (local address 127.19.242.254:35585)
0808 08:41:05.835459 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.835467 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.836813 (+ 1346us) server_negotiation.cc:407] Connection header received
0808 08:41:05.842641 (+ 5828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.842652 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.842860 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.843020 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.846885 (+ 3865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.848090 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.850124 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.850912 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.851065 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.856735 (+ 5670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.856743 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.856747 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.856797 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.860587 (+ 3790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.863512 (+ 2925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.863519 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.863522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.863712 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.864225 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.864234 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.864236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.864606 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.864753 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.865446 (+ 693us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.865750 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":337,"threads_started":1}
I20260808 08:41:05.866214 30516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.834533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:56483 (local address 127.19.242.253:45077)
0808 08:41:05.835041 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.835048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.839684 (+ 4636us) server_negotiation.cc:407] Connection header received
0808 08:41:05.841296 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.841305 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.841426 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.841650 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.845587 (+ 3937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.846928 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.849326 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.850068 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.850173 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.857585 (+ 7412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.857591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.857594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.857632 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.861927 (+ 4295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.863089 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.863097 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.863101 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.863283 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.864048 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.864055 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.864061 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.864538 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.864702 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.865518 (+ 816us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.865798 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":514,"threads_started":1}
I20260808 08:41:05.868887 30518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.835261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.193:38311)
0808 08:41:05.836572 (+ 1311us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.836648 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.840781 (+ 4133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.843080 (+ 2299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.843085 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.844064 (+ 979us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.845341 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.845365 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.848273 (+ 2908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.848279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.849930 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.849946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.851404 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.851413 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.851642 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.852823 (+ 1181us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.852849 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.856461 (+ 3612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.862824 (+ 6363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.862829 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.862832 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.863357 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.863880 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.863885 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.863888 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.864085 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.864851 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.864854 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.865056 (+ 202us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.866457 (+ 1401us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.867173 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":912,"mutex_wait_us":128,"spinlock_wait_cycles":90880,"thread_start_us":3480,"threads_started":1}
I20260808 08:41:05.868916 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.835353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.19.242.193:56483)
0808 08:41:05.839337 (+ 3984us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.839365 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.840787 (+ 1422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.842204 (+ 1417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.842218 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.844124 (+ 1906us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.845342 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.845368 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.847131 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.847140 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.849118 (+ 1978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.849143 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.850606 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.850616 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.850987 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.852221 (+ 1234us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.852249 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.857339 (+ 5090us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.862109 (+ 4770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.862116 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.862121 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.862880 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.863459 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.863464 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.863469 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.863864 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.864796 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.864801 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.865004 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.866521 (+ 1517us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.867297 (+ 776us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3793,"mutex_wait_us":479,"thread_start_us":625,"threads_started":1}
I20260808 08:41:05.868966 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.839778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.19.242.193:38447)
0808 08:41:05.840934 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:05.840954 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:05.841227 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:05.842204 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:05.842218 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:05.844068 (+ 1850us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:05.845873 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.845887 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.847075 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.847080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.849115 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:05.849131 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.850605 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.850611 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:05.850979 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.851982 (+ 1003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:05.852043 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:05.856139 (+ 4096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:05.861568 (+ 5429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.861580 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.861604 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.862392 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.862973 (+ 581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:05.862981 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:05.862985 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:05.863303 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:05.864322 (+ 1019us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:05.864334 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:05.864822 (+ 488us) client_negotiation.cc:769] Sending connection context
0808 08:41:05.866457 (+ 1635us) client_negotiation.cc:240] Negotiation successful
0808 08:41:05.867508 (+ 1051us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":1461,"spinlock_wait_cycles":5376,"thread_start_us":865,"threads_started":1}
I20260808 08:41:05.870903 30512 heartbeater.cc:347] Connected to a master server at 127.19.242.253:45077
I20260808 08:41:05.871254 30511 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35585
I20260808 08:41:05.871261 30510 heartbeater.cc:347] Connected to a master server at 127.19.242.252:35639
I20260808 08:41:05.871347 30512 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:05.871419 30511 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:05.871527 30510 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:05.872439 30512 heartbeater.cc:511] Master 127.19.242.253:45077 requested a full tablet report, sending...
I20260808 08:41:05.872450 30510 heartbeater.cc:511] Master 127.19.242.252:35639 requested a full tablet report, sending...
I20260808 08:41:05.873555 30511 heartbeater.cc:511] Master 127.19.242.254:35585 requested a full tablet report, sending...
I20260808 08:41:05.875357 30233 ts_manager.cc:194] Registered new tserver with Master: 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907)
I20260808 08:41:05.875615 29066 ts_manager.cc:194] Re-registered known tserver with Master: 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907)
I20260808 08:41:05.876753 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:05.841231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33062 (local address 127.19.242.194:40985)
0808 08:41:05.843783 (+ 2552us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:05.843792 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:05.844971 (+ 1179us) server_negotiation.cc:407] Connection header received
0808 08:41:05.845180 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:05.845191 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:05.845484 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:05.845674 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:05.849835 (+ 4161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.853191 (+ 3356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.857857 (+ 4666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:05.859102 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:05.859270 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:05.867243 (+ 7973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:05.867260 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:05.867275 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:05.867363 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:05.872629 (+ 5266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.873726 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.873736 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.873739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.874069 (+ 330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:05.874609 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:05.874614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:05.874617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:05.875145 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:05.875480 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:05.875905 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 08:41:05.876217 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1626,"thread_start_us":1979,"threads_started":1}
I20260808 08:41:05.876816 29066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:38311
I20260808 08:41:05.878111 29957 ts_manager.cc:194] Registered new tserver with Master: 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907)
I20260808 08:41:05.878525 29524 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:05.974155 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 29337
I20260808 08:41:06.000828 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:40985
--local_ip_for_outbound_sockets=127.19.242.194
--tserver_master_addrs=127.19.242.254:35585
--webserver_port=41137
--webserver_interface=127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab
--principal=oryx/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:06.061491 29894 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: NON_VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: true } } }
I20260808 08:41:06.061990 29894 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:06.064291 30528 raft_consensus.cc:1050] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: attempting to promote NON_VOTER 8adabf39b3464902b9752bfe5ad40e68 to VOTER
I20260808 08:41:06.065133 30528 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } }
I20260808 08:41:06.067446 29967 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Refusing update from remote peer fc5386c578ab40328a4c15e4bad3a9f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 08:41:06.067484 30245 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 LEARNER]: Refusing update from remote peer fc5386c578ab40328a4c15e4bad3a9f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 08:41:06.068197 30529 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 08:41:06.068727 29894 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 08:41:06.072659 29967 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.071856 30529 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.075268 30245 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.077411 30529 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.077862 30529 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:06.078338 30529 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.078919 30529 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:06.079968 30533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.080190 29894 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.080466 29894 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:06.080520 30533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:41:06.083034 30535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:06.083371 30535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 08:41:06.387828 30526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:06.388156 30526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:06.388350 30526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:06.396423 30526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:06.396616 30526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:06.396824 30526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:06.407595 30526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab
--principal=oryx/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:40985
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=41137
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:06.409288 30526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:06.410791 30526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:06.427130 30546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:06.427131 30547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:06.427131 30550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:06.427878 30526 server_base.cc:1034] running on GCE node
I20260808 08:41:06.428691 30526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:06.430190 30526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:06.431465 30526 hybrid_clock.cc:648] HybridClock initialized: now 1786178466431391 us; error 63 us; skew 500 ppm
I20260808 08:41:06.431908 30526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:06 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178466, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:06.436303 30526 init.cc:377] Logged in from keytab as oryx/127.19.242.194@KRBTEST.COM (short username oryx)
I20260808 08:41:06.437985 30526 webserver.cc:460] Webserver started at http://127.19.242.194:41137/ using document root <none> and password file <none>
I20260808 08:41:06.438861 30526 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:06.439052 30526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:06.445039 30526 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:41:06.448800 30559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:06.450345 30526 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:41:06.450556 30526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "c4f56bcae994400c89614373615de47a"
format_stamp: "Formatted at 2026-08-08 08:41:02 on dist-test-slave-39l8"
server_key: "d8c14e850472d2231b34f7e6cf1a7949"
server_key_iv: "893a10f3d0a68177a7a32b8e138c881a"
server_key_version: "encryptionkey@0"
I20260808 08:41:06.451732 30526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:06.504042 30526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:06.509195 30526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:06.509600 30526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:06.510852 30526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:06.512748 30526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:06.512892 30526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:06.513038 30526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:06.513136 30526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:06.553973 30526 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:40985
I20260808 08:41:06.554103 30725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:40985 every 8 connection(s)
I20260808 08:41:06.555855 30526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:06.560286 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 30526
I20260808 08:41:06.560634 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 29539
Aug 08 08:41:06 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.195@KRBTEST.COM
I20260808 08:41:06.596112 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:06.561727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56420 (local address 127.19.242.195:38867)
0808 08:41:06.567433 (+ 5706us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:06.567446 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:06.567497 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:41:06.567640 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:06.567654 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:06.568043 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:06.568277 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:06.571810 (+ 3533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.574147 (+ 2337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.577202 (+ 3055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.578615 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.579667 (+ 1052us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:06.586660 (+ 6993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:06.586685 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:06.586769 (+ 84us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:06.586844 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:06.591398 (+ 4554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.592496 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.592510 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.592515 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.592732 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.593365 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.593374 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.593380 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.593965 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:06.594376 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:06.595095 (+ 719us) server_negotiation.cc:299] Negotiation successful
0808 08:41:06.595436 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5484,"thread_start_us":5321,"threads_started":1}
I20260808 08:41:06.597817 29726 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 08 08:41:06 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178466, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.253@KRBTEST.COM
Aug 08 08:41:06 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178466, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
Aug 08 08:41:06 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178466, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.252@KRBTEST.COM
I20260808 08:41:06.615052 30732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:06.559510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:33411 (local address 127.19.242.253:45077)
0808 08:41:06.579531 (+ 20021us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:06.579536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:06.584388 (+ 4852us) server_negotiation.cc:407] Connection header received
0808 08:41:06.588033 (+ 3645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:06.588040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:06.588147 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:06.588249 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:06.591406 (+ 3157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.592596 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.595365 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.596058 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.596213 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:06.603460 (+ 7247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:06.603468 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:06.603473 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:06.603520 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:06.607752 (+ 4232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.609119 (+ 1367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.609129 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.609135 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.609370 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.610567 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.610576 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.610583 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.611167 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:06.611378 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:06.614071 (+ 2693us) server_negotiation.cc:299] Negotiation successful
0808 08:41:06.614452 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19912,"thread_start_us":19745,"threads_started":1}
I20260808 08:41:06.617691 30733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:06.560990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.19.242.194:33411)
0808 08:41:06.584256 (+ 23266us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:06.584272 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:06.587054 (+ 2782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:06.588534 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:06.588542 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:06.590094 (+ 1552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:06.591151 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:06.591185 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.592792 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.592798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:06.595147 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:06.595173 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.597525 (+ 2352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.597533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:06.597903 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:06.598862 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:06.598902 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:06.602786 (+ 3884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:06.608059 (+ 5273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:06.608072 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:06.608095 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:06.608867 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:06.609568 (+ 701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:06.609577 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:06.609583 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:06.610368 (+ 785us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:06.611584 (+ 1216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:06.611598 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:06.612331 (+ 733us) client_negotiation.cc:769] Sending connection context
0808 08:41:06.615715 (+ 3384us) client_negotiation.cc:240] Negotiation successful
0808 08:41:06.616382 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23145,"thread_start_us":21989,"threads_started":1}
I20260808 08:41:06.618274 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:06.587569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:50679 (local address 127.19.242.252:35639)
0808 08:41:06.591786 (+ 4217us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:06.591796 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:06.591825 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:41:06.591890 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:06.591898 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:06.592022 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:06.592149 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:06.593790 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.598193 (+ 4403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.601091 (+ 2898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.601673 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.601812 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:06.607231 (+ 5419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:06.607240 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:06.607247 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:06.607304 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:06.613106 (+ 5802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.614604 (+ 1498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.614614 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.614620 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.614841 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.615404 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.615412 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.615418 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.615917 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:06.616082 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:06.617591 (+ 1509us) server_negotiation.cc:299] Negotiation successful
0808 08:41:06.617886 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4065,"thread_start_us":377,"threads_started":1}
I20260808 08:41:06.619984 30728 heartbeater.cc:347] Connected to a master server at 127.19.242.253:45077
I20260808 08:41:06.620405 30728 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:06.620958 30740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:06.588226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.19.242.194:50679)
0808 08:41:06.590319 (+ 2093us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:06.590336 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:06.590451 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:06.592178 (+ 1727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:06.592182 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:06.592921 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:06.593542 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:06.593557 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.598411 (+ 4854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.598418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:06.600121 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:06.600142 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.602534 (+ 2392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.602542 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:06.602795 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:06.603436 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:06.603459 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:06.606887 (+ 3428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:06.613265 (+ 6378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:06.613272 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:06.613277 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:06.614397 (+ 1120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:06.615015 (+ 618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:06.615024 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:06.615030 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:06.615248 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:06.616170 (+ 922us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:06.616175 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:06.616363 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 08:41:06.616508 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 08:41:06.616832 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1953,"thread_start_us":1747,"threads_started":1}
I20260808 08:41:06.621503 30728 heartbeater.cc:511] Master 127.19.242.253:45077 requested a full tablet report, sending...
I20260808 08:41:06.622145 30731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:06.559475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:34383 (local address 127.19.242.254:35585)
0808 08:41:06.578425 (+ 18950us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:06.578434 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:06.583767 (+ 5333us) server_negotiation.cc:407] Connection header received
0808 08:41:06.587486 (+ 3719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:06.587493 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:06.587599 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:06.587732 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:06.592832 (+ 5100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.594184 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.597679 (+ 3495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.598524 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.598728 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:06.607719 (+ 8991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:06.607729 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:06.607736 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:06.607803 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:06.612389 (+ 4586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.618899 (+ 6510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.618907 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.618910 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.619132 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:06.619686 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:06.619695 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:06.619699 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:06.620118 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:06.620295 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:06.621355 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0808 08:41:06.621706 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18745,"thread_start_us":18957,"threads_started":1}
I20260808 08:41:06.622141 30726 heartbeater.cc:347] Connected to a master server at 127.19.242.252:35639
I20260808 08:41:06.622296 30726 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:06.622864 30726 heartbeater.cc:511] Master 127.19.242.252:35639 requested a full tablet report, sending...
I20260808 08:41:06.623512 30734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:06.560192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.194:34383)
0808 08:41:06.583493 (+ 23301us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:06.583569 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:06.587124 (+ 3555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:06.588485 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:06.588499 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:06.591511 (+ 3012us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:06.591818 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:06.591831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.594853 (+ 3022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.594860 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:06.597491 (+ 2631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:06.597507 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:06.600403 (+ 2896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:06.600411 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:06.600655 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:06.602125 (+ 1470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:06.602149 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:06.607358 (+ 5209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:06.612616 (+ 5258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:06.612624 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:06.612630 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:06.618648 (+ 6018us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:06.619314 (+ 666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:06.619319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:06.619323 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:06.619487 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:06.620402 (+ 915us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:06.620408 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:06.620612 (+ 204us) client_negotiation.cc:769] Sending connection context
0808 08:41:06.622368 (+ 1756us) client_negotiation.cc:240] Negotiation successful
0808 08:41:06.622832 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22923,"thread_start_us":26555,"threads_started":1}
I20260808 08:41:06.624153 29957 ts_manager.cc:194] Registered new tserver with Master: c4f56bcae994400c89614373615de47a (127.19.242.194:40985)
I20260808 08:41:06.624296 30233 ts_manager.cc:194] Registered new tserver with Master: c4f56bcae994400c89614373615de47a (127.19.242.194:40985)
I20260808 08:41:06.625527 30727 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35585
I20260808 08:41:06.625691 30727 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:06.626195 30727 heartbeater.cc:511] Master 127.19.242.254:35585 requested a full tablet report, sending...
I20260808 08:41:06.627568 29066 ts_manager.cc:194] Re-registered known tserver with Master: c4f56bcae994400c89614373615de47a (127.19.242.194:40985)
I20260808 08:41:06.628870 29066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:34383
I20260808 08:41:06.703650 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 29539
I20260808 08:41:06.733577 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:38867
--local_ip_for_outbound_sockets=127.19.242.195
--tserver_master_addrs=127.19.242.254:35585
--webserver_port=37143
--webserver_interface=127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab
--principal=oryx/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:06.880371 30511 heartbeater.cc:503] Master 127.19.242.254:35585 was elected leader, sending a full tablet report...
W20260808 08:41:07.129540 30743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:07.129878 30743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:07.129980 30743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:07.137728 30743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:07.137874 30743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:07.137991 30743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:07.148998 30743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab
--principal=oryx/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:38867
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=37143
--tserver_master_addrs=127.19.242.254:35585,127.19.242.253:45077,127.19.242.252:35639
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:07.150427 30743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:07.151901 30743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:07.167893 30750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:07.167940 30754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:07.167943 30751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:07.170213 30743 server_base.cc:1034] running on GCE node
I20260808 08:41:07.171202 30743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:07.172441 30743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:07.173781 30743 hybrid_clock.cc:648] HybridClock initialized: now 1786178467173716 us; error 60 us; skew 500 ppm
I20260808 08:41:07.174309 30743 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:07 dist-test-slave-39l8 krb5kdc[28998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178467, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:07.178506 30743 init.cc:377] Logged in from keytab as oryx/127.19.242.195@KRBTEST.COM (short username oryx)
I20260808 08:41:07.180572 30743 webserver.cc:460] Webserver started at http://127.19.242.195:37143/ using document root <none> and password file <none>
I20260808 08:41:07.181558 30743 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:07.181768 30743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:07.188956 30743 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:41:07.192689 30763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:07.194671 30743 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:41:07.194974 30743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "293082b145e34462951edfc51cf50f98"
format_stamp: "Formatted at 2026-08-08 08:41:03 on dist-test-slave-39l8"
server_key: "3ad00b8ba14d631e68368dedf3d2a475"
server_key_iv: "2dc11a6a3401587e6cd3620cd519ff07"
server_key_version: "encryptionkey@0"
I20260808 08:41:07.196055 30743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:07.228708 30743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:07.234579 30743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:07.235018 30743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:07.236306 30743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:07.237957 30743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:07.238073 30743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:07.238179 30743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:07.238245 30743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:07.281284 30743 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:38867
I20260808 08:41:07.281425 30938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:38867 every 8 connection(s)
I20260808 08:41:07.283197 30743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:07.285897 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 30743
Aug 08 08:41:07 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178467, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.252@KRBTEST.COM
Aug 08 08:41:07 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178467, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
Aug 08 08:41:07 dist-test-slave-39l8 krb5kdc[28998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178467, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.253@KRBTEST.COM
I20260808 08:41:07.338593 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.291894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58643 (local address 127.19.242.254:35585)
0808 08:41:07.299241 (+ 7347us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.299251 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.306609 (+ 7358us) server_negotiation.cc:407] Connection header received
0808 08:41:07.306930 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.306940 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.307102 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.307271 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.313958 (+ 6687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.315693 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.320632 (+ 4939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.321354 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.321512 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.328279 (+ 6767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.328288 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.328293 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.328349 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.333278 (+ 4929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.334511 (+ 1233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.334522 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.334528 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.334791 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.336021 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.336026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.336029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.336495 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.336704 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.337917 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.338202 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7141,"thread_start_us":7019,"threads_started":1}
I20260808 08:41:07.342940 30949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.288773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.19.242.195:53705)
0808 08:41:07.290870 (+ 2097us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.290950 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.294780 (+ 3830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.309150 (+ 14370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.309160 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.314465 (+ 5305us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:07.314963 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.314989 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.317554 (+ 2565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.317564 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.320059 (+ 2495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.320070 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.321899 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.321906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.322290 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.323305 (+ 1015us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:07.323342 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:07.328514 (+ 5172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:07.334686 (+ 6172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:07.334692 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:07.334696 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:07.335865 (+ 1169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:07.340116 (+ 4251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:07.340125 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:07.340132 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:07.340489 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:07.341416 (+ 927us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:07.341421 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:07.341632 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.341800 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.342140 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1585,"mutex_wait_us":85,"thread_start_us":1116,"threads_started":1}
I20260808 08:41:07.345110 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.291826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.195:58643)
0808 08:41:07.306383 (+ 14557us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.306414 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.306675 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.308588 (+ 1913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.308609 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.311870 (+ 3261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:07.313502 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.313553 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.317244 (+ 3691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.317249 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.320445 (+ 3196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.320454 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.323689 (+ 3235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.323695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.323886 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.324595 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:07.324619 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:07.327947 (+ 3328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:07.333455 (+ 5508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:07.333467 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:07.333493 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:07.334289 (+ 796us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:07.335597 (+ 1308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:07.335602 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:07.335606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:07.335894 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:07.336824 (+ 930us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:07.336833 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:07.337404 (+ 571us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.337788 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.338409 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14338,"mutex_wait_us":1,"spinlock_wait_cycles":1408,"thread_start_us":18704,"threads_started":1}
I20260808 08:41:07.345767 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.289813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:53705 (local address 127.19.242.252:35639)
0808 08:41:07.308511 (+ 18698us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.308523 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.308559 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:41:07.308648 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.308659 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.308795 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.309348 (+ 553us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.315439 (+ 6091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.317282 (+ 1843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.320684 (+ 3402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.321387 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.321511 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.328801 (+ 7290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.328809 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.328814 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.328862 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.333069 (+ 4207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.339597 (+ 6528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.339607 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.339613 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.339902 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.340731 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.340739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.340745 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.341240 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.343542 (+ 2302us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.344561 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.344884 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18051,"thread_start_us":17891,"threads_started":1}
I20260808 08:41:07.347080 30941 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35585
I20260808 08:41:07.347453 30941 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:07.348556 30941 heartbeater.cc:511] Master 127.19.242.254:35585 requested a full tablet report, sending...
I20260808 08:41:07.347055 30940 heartbeater.cc:347] Connected to a master server at 127.19.242.252:35639
I20260808 08:41:07.349563 30940 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:07.350248 30940 heartbeater.cc:511] Master 127.19.242.252:35639 requested a full tablet report, sending...
I20260808 08:41:07.351598 29066 ts_manager.cc:194] Re-registered known tserver with Master: 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867)
I20260808 08:41:07.352046 30233 ts_manager.cc:194] Registered new tserver with Master: 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867)
I20260808 08:41:07.352826 29066 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:58643
I20260808 08:41:07.360380 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.293873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.19.242.195:47887)
0808 08:41:07.316816 (+ 22943us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.316834 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.317020 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.318873 (+ 1853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.318879 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.319606 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:07.320055 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.320070 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.321752 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.321758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.323409 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.323434 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.326089 (+ 2655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.326101 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.326394 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.327809 (+ 1415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:07.327859 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:07.337514 (+ 9655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:07.343730 (+ 6216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:07.343736 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:07.343740 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:07.344345 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:07.349961 (+ 5616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:07.349968 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:07.349972 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:07.350223 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:07.358954 (+ 8731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:07.358961 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:07.359201 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.359395 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.359814 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22796,"spinlock_wait_cycles":35712,"thread_start_us":12079,"threads_started":1}
I20260808 08:41:07.363134 30957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.294605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:47887 (local address 127.19.242.253:45077)
0808 08:41:07.305683 (+ 11078us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.305693 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.316956 (+ 11263us) server_negotiation.cc:407] Connection header received
0808 08:41:07.317172 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.317180 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.317293 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.317426 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.320319 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.321562 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.324967 (+ 3405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.325823 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.326024 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.337911 (+ 11887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.337924 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.337933 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.338005 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.343551 (+ 5546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.349055 (+ 5504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.349067 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.349073 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.349391 (+ 318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.352191 (+ 2800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.352197 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.352201 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.352622 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.359055 (+ 6433us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.362066 (+ 3011us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.362559 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10863,"thread_start_us":10696,"threads_started":1}
I20260808 08:41:07.364480 30944 heartbeater.cc:347] Connected to a master server at 127.19.242.253:45077
I20260808 08:41:07.364717 30944 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:07.366671 30944 heartbeater.cc:511] Master 127.19.242.253:45077 requested a full tablet report, sending...
I20260808 08:41:07.368722 29957 ts_manager.cc:194] Registered new tserver with Master: 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867)
I20260808 08:41:07.378527 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.345046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44008 (local address 127.19.242.252:35639)
0808 08:41:07.346787 (+ 1741us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.346793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.353606 (+ 6813us) server_negotiation.cc:407] Connection header received
0808 08:41:07.355483 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.355489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.355635 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.355725 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.360832 (+ 5107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.362085 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.364414 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.365140 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.365271 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.370075 (+ 4804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.370086 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.370095 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.370164 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.374829 (+ 4665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.375807 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.375814 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.375817 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.375982 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.376448 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.376454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.376458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.377160 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.377448 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.377897 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.378152 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1588,"thread_start_us":25996,"threads_started":1}
I20260808 08:41:07.382169 30954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.322195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49256 (local address 127.19.242.254:35585)
0808 08:41:07.339097 (+ 16902us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.339103 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.339127 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:41:07.339201 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.339209 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.339309 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.339439 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.348055 (+ 8616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.349579 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.352094 (+ 2515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.354153 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.354289 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.373996 (+ 19707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.374003 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.374007 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.374078 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.378465 (+ 4387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.379638 (+ 1173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.379645 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.379649 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.379848 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.380452 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.380456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.380458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.380837 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.381133 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.381533 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.381787 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1302,"server-negotiator.queue_time_us":16733,"thread_start_us":26539,"threads_started":1}
I20260808 08:41:07.383147 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.323462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34790 (local address 127.19.242.253:45077)
0808 08:41:07.339664 (+ 16202us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.339671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.344506 (+ 4835us) server_negotiation.cc:407] Connection header received
0808 08:41:07.344582 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.344587 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.344668 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.344784 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.357176 (+ 12392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.358695 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.360819 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.361723 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.361882 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.374501 (+ 12619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.374510 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.374515 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.374567 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.379270 (+ 4703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.380131 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.380139 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.380145 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.380367 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.380800 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.380806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.380809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.381212 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.381489 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.381862 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.382112 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16021,"thread_start_us":15811,"threads_started":1}
I20260808 08:41:07.387821 29066 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:41:07.396955 29066 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:07.453095 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.422011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34356 (local address 127.19.242.193:32907)
0808 08:41:07.433367 (+ 11356us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.433382 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.438589 (+ 5207us) server_negotiation.cc:407] Connection header received
0808 08:41:07.438797 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.438807 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.439252 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.439663 (+ 411us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:07.442207 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.444286 (+ 2079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.449530 (+ 5244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.451295 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.451661 (+ 366us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.451995 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.452272 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.452524 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11014,"thread_start_us":11425,"threads_started":1}
I20260808 08:41:07.454099 30988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.421453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:32907 (local address 127.0.0.1:34356)
0808 08:41:07.438267 (+ 16814us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.438292 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.438505 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.440121 (+ 1616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.440127 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.440149 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:07.441897 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.441911 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.444656 (+ 2745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.444661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.449309 (+ 4648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.449327 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.451728 (+ 2401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.451738 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.452031 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.452077 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.452211 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.452381 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14935,"mutex_wait_us":39,"thread_start_us":14617,"threads_started":1}
I20260808 08:41:07.455263 30986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.421022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38867 (local address 127.0.0.1:56434)
0808 08:41:07.437523 (+ 16501us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.437552 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.438095 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.439838 (+ 1743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.439842 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.439869 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:07.440997 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.441019 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.445213 (+ 4194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.445231 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.449143 (+ 3912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.449182 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.453625 (+ 4443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.453634 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.453940 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.454006 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.454161 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.454336 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14922,"mutex_wait_us":39,"thread_start_us":14467,"threads_started":1}
I20260808 08:41:07.455948 30987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.421280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56434 (local address 127.19.242.195:38867)
0808 08:41:07.435205 (+ 13925us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.435228 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.437856 (+ 2628us) server_negotiation.cc:407] Connection header received
0808 08:41:07.438396 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.438411 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.438925 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.439321 (+ 396us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:07.441771 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.444990 (+ 3219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.449480 (+ 4490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.452240 (+ 2760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.452516 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.452728 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.455110 (+ 2382us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.455514 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13487,"thread_start_us":13126,"threads_started":1}
I20260808 08:41:07.456324 30993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.436338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:40985 (local address 127.0.0.1:33064)
0808 08:41:07.439890 (+ 3552us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.439936 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.440142 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.441127 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.441132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.441161 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:07.444155 (+ 2994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.444176 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.446566 (+ 2390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.446575 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.451445 (+ 4870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.451467 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.455248 (+ 3781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.455259 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.455507 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.455547 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.455666 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.455835 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3331,"mutex_wait_us":93,"thread_start_us":2775,"threads_started":1}
I20260808 08:41:07.457233 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.436749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33064 (local address 127.19.242.194:40985)
0808 08:41:07.437913 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.437926 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.440137 (+ 2211us) server_negotiation.cc:407] Connection header received
0808 08:41:07.440345 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.440355 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.440763 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.441106 (+ 343us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:07.444557 (+ 3451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.446372 (+ 1815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.451804 (+ 5432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.454239 (+ 2435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.454535 (+ 296us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.454807 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.456733 (+ 1926us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.456976 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":957,"thread_start_us":647,"threads_started":1}
I20260808 08:41:07.460000 30403 tablet_service.cc:1467] Processing CreateTablet for tablet 9e52c099387245ef9630a56173c30566 (DEFAULT_TABLE table=test-table [id=9533b11a6c0841cdb775c8cbeee77306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:07.460703 30838 tablet_service.cc:1467] Processing CreateTablet for tablet 9e52c099387245ef9630a56173c30566 (DEFAULT_TABLE table=test-table [id=9533b11a6c0841cdb775c8cbeee77306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:07.461683 30403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e52c099387245ef9630a56173c30566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:07.461551 30631 tablet_service.cc:1467] Processing CreateTablet for tablet 9e52c099387245ef9630a56173c30566 (DEFAULT_TABLE table=test-table [id=9533b11a6c0841cdb775c8cbeee77306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:07.462321 30838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e52c099387245ef9630a56173c30566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:07.463152 30631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e52c099387245ef9630a56173c30566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:07.482933 30994 tablet_bootstrap.cc:492] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Bootstrap starting.
I20260808 08:41:07.487879 30999 tablet_bootstrap.cc:492] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Bootstrap starting.
I20260808 08:41:07.489368 30994 tablet_bootstrap.cc:654] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:07.491104 30994 log.cc:824] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:07.492837 30995 tablet_bootstrap.cc:492] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Bootstrap starting.
I20260808 08:41:07.496985 30999 tablet_bootstrap.cc:654] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:07.498833 30999 log.cc:824] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:07.499145 30995 tablet_bootstrap.cc:654] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:07.500934 30995 log.cc:824] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:07.501926 30994 tablet_bootstrap.cc:492] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: No bootstrap required, opened a new log
I20260808 08:41:07.502288 30994 ts_tablet_manager.cc:1397] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.000s
I20260808 08:41:07.503548 30999 tablet_bootstrap.cc:492] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: No bootstrap required, opened a new log
I20260808 08:41:07.503913 30999 ts_tablet_manager.cc:1397] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.000s
I20260808 08:41:07.504845 30995 tablet_bootstrap.cc:492] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: No bootstrap required, opened a new log
I20260808 08:41:07.505162 30995 ts_tablet_manager.cc:1397] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260808 08:41:07.511524 30994 raft_consensus.cc:348] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.512020 30994 raft_consensus.cc:374] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:07.512140 30994 raft_consensus.cc:729] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e63794ec66c43b0ae08bdffd18aaf5b, State: Initialized, Role: FOLLOWER
I20260808 08:41:07.512923 30994 consensus_queue.cc:260] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.516363 30999 raft_consensus.cc:348] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.516932 30999 raft_consensus.cc:374] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:07.517114 30999 raft_consensus.cc:729] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4f56bcae994400c89614373615de47a, State: Initialized, Role: FOLLOWER
I20260808 08:41:07.517144 30995 raft_consensus.cc:348] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.517616 30995 raft_consensus.cc:374] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:07.517714 30995 raft_consensus.cc:729] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293082b145e34462951edfc51cf50f98, State: Initialized, Role: FOLLOWER
I20260808 08:41:07.517939 30999 consensus_queue.cc:260] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.518412 30995 consensus_queue.cc:260] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.519351 30994 ts_tablet_manager.cc:1428] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Time spent starting tablet: real 0.017s user 0.005s sys 0.009s
I20260808 08:41:07.525442 30727 heartbeater.cc:503] Master 127.19.242.254:35585 was elected leader, sending a full tablet report...
I20260808 08:41:07.526459 30995 ts_tablet_manager.cc:1428] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Time spent starting tablet: real 0.021s user 0.012s sys 0.010s
I20260808 08:41:07.526926 30941 heartbeater.cc:503] Master 127.19.242.254:35585 was elected leader, sending a full tablet report...
I20260808 08:41:07.527448 30999 ts_tablet_manager.cc:1428] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Time spent starting tablet: real 0.023s user 0.017s sys 0.004s
W20260808 08:41:07.566385 30729 tablet.cc:2369] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:41:07.566879 30945 tablet.cc:2369] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:41:07.585978 30513 tablet.cc:2369] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:41:07.617758 31006 raft_consensus.cc:482] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:07.618057 31006 raft_consensus.cc:504] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.619877 31006 leader_election.cc:288] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867), c4f56bcae994400c89614373615de47a (127.19.242.194:40985)
I20260808 08:41:07.627996 30987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.620370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:59027 (local address 127.19.242.195:38867)
0808 08:41:07.620631 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.620636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.621309 (+ 673us) server_negotiation.cc:407] Connection header received
0808 08:41:07.621565 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.621571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.621663 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.621772 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:07.622600 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.623654 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.625830 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.627018 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.627148 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.627206 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.627686 (+ 480us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.627808 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:41:07.628258 31010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.620438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38867 (local address 127.19.242.193:59027)
0808 08:41:07.621158 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.621177 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.621391 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.621932 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.621938 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.621977 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:07.622437 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.622452 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.623800 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.623806 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.625631 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.625645 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.627252 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.627260 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.627462 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.627502 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.627627 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.627787 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":61,"thread_start_us":419,"threads_started":1}
I20260808 08:41:07.629311 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.621472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:42521 (local address 127.19.242.194:40985)
0808 08:41:07.621817 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.621825 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.622343 (+ 518us) server_negotiation.cc:407] Connection header received
0808 08:41:07.622494 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.622502 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.622598 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.622671 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:07.623309 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.624276 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.626823 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.628240 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.628442 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.628530 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.628927 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.629118 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:41:07.629491 31012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.621323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:40985 (local address 127.19.242.193:42521)
0808 08:41:07.622175 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:07.622191 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:07.622349 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:07.622749 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:07.622757 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:07.622783 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:07.623110 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.623122 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.624429 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.624433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.626539 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:07.626555 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.628506 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.628513 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:07.628723 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.628765 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:41:07.628848 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:41:07.628968 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":42,"thread_start_us":529,"threads_started":1}
I20260808 08:41:07.629674 30869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52c099387245ef9630a56173c30566" candidate_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293082b145e34462951edfc51cf50f98" is_pre_election: true
I20260808 08:41:07.630378 30869 raft_consensus.cc:2454] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e63794ec66c43b0ae08bdffd18aaf5b in term 0.
I20260808 08:41:07.630591 30662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52c099387245ef9630a56173c30566" candidate_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4f56bcae994400c89614373615de47a" is_pre_election: true
I20260808 08:41:07.631201 30331 leader_election.cc:302] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293082b145e34462951edfc51cf50f98, 9e63794ec66c43b0ae08bdffd18aaf5b; no voters:
I20260808 08:41:07.631240 30662 raft_consensus.cc:2454] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e63794ec66c43b0ae08bdffd18aaf5b in term 0.
I20260808 08:41:07.631639 31006 raft_consensus.cc:2781] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:07.631856 31006 raft_consensus.cc:482] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:07.631982 31006 raft_consensus.cc:3037] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:07.634907 31006 raft_consensus.cc:504] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.635615 31006 leader_election.cc:288] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [CANDIDATE]: Term 1 election: Requested vote from peers 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867), c4f56bcae994400c89614373615de47a (127.19.242.194:40985)
I20260808 08:41:07.636375 30869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52c099387245ef9630a56173c30566" candidate_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293082b145e34462951edfc51cf50f98"
I20260808 08:41:07.636397 30662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e52c099387245ef9630a56173c30566" candidate_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4f56bcae994400c89614373615de47a"
I20260808 08:41:07.636644 30869 raft_consensus.cc:3037] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:07.636684 30662 raft_consensus.cc:3037] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:07.640283 30869 raft_consensus.cc:2454] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e63794ec66c43b0ae08bdffd18aaf5b in term 1.
I20260808 08:41:07.640283 30662 raft_consensus.cc:2454] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e63794ec66c43b0ae08bdffd18aaf5b in term 1.
I20260808 08:41:07.640851 30331 leader_election.cc:302] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e63794ec66c43b0ae08bdffd18aaf5b, c4f56bcae994400c89614373615de47a; no voters:
I20260808 08:41:07.641276 31006 raft_consensus.cc:2781] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:07.641852 31006 raft_consensus.cc:686] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 LEADER]: Becoming Leader. State: Replica: 9e63794ec66c43b0ae08bdffd18aaf5b, State: Running, Role: LEADER
I20260808 08:41:07.642460 31006 consensus_queue.cc:237] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:07.647989 29065 catalog_manager.cc:5495] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193). New cstate: current_term: 1 leader_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } health_report { overall_health: HEALTHY } } }
I20260808 08:41:07.698748 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.692938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34372 (local address 127.19.242.193:32907)
0808 08:41:07.693169 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.693175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.693196 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:41:07.693420 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.693425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.693525 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.693694 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:07.694129 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.694942 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.696333 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.696784 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.696924 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.697465 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:07.698025 (+ 560us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:07.698197 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.698267 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.698359 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:41:07.709594 30662 raft_consensus.cc:1261] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 1 FOLLOWER]: Refusing update from remote peer 9e63794ec66c43b0ae08bdffd18aaf5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:07.709672 30869 raft_consensus.cc:1261] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Refusing update from remote peer 9e63794ec66c43b0ae08bdffd18aaf5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:07.710810 31013 consensus_queue.cc:1035] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:07.711234 31006 consensus_queue.cc:1035] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:07.727857 31016 mvcc.cc:205] Tried to move back new op lower bound from 7316187003726004224 to 7316187003467653120. Current Snapshot: MvccSnapshot[applied={T|T < 7316187003726004224}]
I20260808 08:41:07.729063 31017 mvcc.cc:205] Tried to move back new op lower bound from 7316187003726004224 to 7316187003467653120. Current Snapshot: MvccSnapshot[applied={T|T < 7316187003726004224}]
I20260808 08:41:07.751518 29065 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:07.751879 29065 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:07.760121 29065 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc5386c578ab40328a4c15e4bad3a9f0: Sending DeleteTablet for 3 replicas of tablet 9e52c099387245ef9630a56173c30566
I20260808 08:41:07.761338 30838 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e52c099387245ef9630a56173c30566 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:07 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:56434
I20260808 08:41:07.763829 30631 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e52c099387245ef9630a56173c30566 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:07 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:33064
I20260808 08:41:07.764779 31036 tablet_replica.cc:330] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: stopping tablet replica
I20260808 08:41:07.765065 31038 tablet_replica.cc:330] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: stopping tablet replica
I20260808 08:41:07.765583 31038 raft_consensus.cc:2229] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:07.765614 31036 raft_consensus.cc:2229] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:07.766212 31038 raft_consensus.cc:2258] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:07.766391 31036 raft_consensus.cc:2258] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:07.768700 31038 ts_tablet_manager.cc:1905] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:07.769790 31036 ts_tablet_manager.cc:1905] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:07.776640 31038 ts_tablet_manager.cc:1918] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:07.776893 31038 log.cc:1196] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/9e52c099387245ef9630a56173c30566
I20260808 08:41:07.777515 31038 ts_tablet_manager.cc:1939] T 9e52c099387245ef9630a56173c30566 P c4f56bcae994400c89614373615de47a: Deleting consensus metadata
I20260808 08:41:07.779829 29039 catalog_manager.cc:4841] TS c4f56bcae994400c89614373615de47a (127.19.242.194:40985): tablet 9e52c099387245ef9630a56173c30566 (table test-table [id=9533b11a6c0841cdb775c8cbeee77306]) successfully deleted
I20260808 08:41:07.780248 30403 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e52c099387245ef9630a56173c30566 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:07 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:34356
I20260808 08:41:07.781582 31040 tablet_replica.cc:330] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: stopping tablet replica
I20260808 08:41:07.784183 31036 ts_tablet_manager.cc:1918] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:07.784425 31036 log.cc:1196] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/9e52c099387245ef9630a56173c30566
I20260808 08:41:07.786546 31040 raft_consensus.cc:2229] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:41:07.787197 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 29016
I20260808 08:41:07.788234 31040 raft_consensus.cc:2258] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:07.788565 29107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:07.788576 31036 ts_tablet_manager.cc:1939] T 9e52c099387245ef9630a56173c30566 P 293082b145e34462951edfc51cf50f98: Deleting consensus metadata
I20260808 08:41:07.793081 29039 catalog_manager.cc:4841] TS 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867): tablet 9e52c099387245ef9630a56173c30566 (table test-table [id=9533b11a6c0841cdb775c8cbeee77306]) successfully deleted
I20260808 08:41:07.796052 31040 ts_tablet_manager.cc:1905] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:07.809022 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.785797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34798 (local address 127.19.242.253:45077)
0808 08:41:07.786034 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.786040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.786062 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:41:07.786142 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.786148 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.786233 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.786339 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.788887 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.790182 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.793762 (+ 3580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.794808 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.794981 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.799971 (+ 4990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.799981 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.799987 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.800058 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.804741 (+ 4683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.806196 (+ 1455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.806203 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.806208 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.806411 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.807008 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.807014 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.807017 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.807470 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.807771 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.808326 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.808620 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:41:07.809829 31040 ts_tablet_manager.cc:1918] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:07.810092 31040 log.cc:1196] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/9e52c099387245ef9630a56173c30566
I20260808 08:41:07.810882 31040 ts_tablet_manager.cc:1939] T 9e52c099387245ef9630a56173c30566 P 9e63794ec66c43b0ae08bdffd18aaf5b: Deleting consensus metadata
I20260808 08:41:07.824556 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:07.786239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.19.242.252:35639)
0808 08:41:07.786402 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:07.786408 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:07.809232 (+ 22824us) server_negotiation.cc:407] Connection header received
0808 08:41:07.809537 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:07.809542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:07.809656 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:07.809736 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:07.812038 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.813125 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.814499 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:07.815078 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:07.815238 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:07.818413 (+ 3175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:07.818418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:07.818421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:07.818463 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:07.821401 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.822145 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.822151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.822155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.822354 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:07.822893 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:07.822899 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:07.822903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:07.823276 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:07.823561 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:07.823905 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 08:41:07.824158 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:41:07.978200 29047 catalog_manager.cc:4841] TS 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907): tablet 9e52c099387245ef9630a56173c30566 (table test-table [id=9533b11a6c0841cdb775c8cbeee77306]) successfully deleted
I20260808 08:41:07.979071 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 29016
I20260808 08:41:08.053296 30950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:08.033280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44036 (local address 127.19.242.252:35639)
0808 08:41:08.033492 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:08.033499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:08.034509 (+ 1010us) server_negotiation.cc:407] Connection header received
0808 08:41:08.034669 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:08.034677 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:08.034826 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:08.034958 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:08.037327 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:08.038155 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:08.040025 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:08.040608 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:08.040764 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:08.044857 (+ 4093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:08.044867 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:08.044876 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:08.044941 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:08.049519 (+ 4578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:08.050836 (+ 1317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:08.050841 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:08.050844 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:08.051008 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:08.051487 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:08.051492 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:08.051496 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:08.051982 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:08.052273 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:08.052679 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 08:41:08.052920 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:41:08.055135 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:08.032293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.19.242.253:45077)
0808 08:41:08.032531 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:08.032540 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:08.033633 (+ 1093us) server_negotiation.cc:407] Connection header received
0808 08:41:08.033976 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:08.033983 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:08.034118 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:08.034213 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:08.036905 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:08.038144 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:08.040551 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:08.041244 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:08.041415 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:08.044634 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:08.044660 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:08.044669 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:08.044735 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:08.049519 (+ 4784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:08.051609 (+ 2090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:08.051616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:08.051619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:08.051789 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:08.052346 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:08.052352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:08.052359 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:08.052792 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:08.053065 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:08.054383 (+ 1318us) server_negotiation.cc:299] Negotiation successful
0808 08:41:08.054662 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:41:08.734741 31053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:08.733715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.195:54425)
0808 08:41:08.734244 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:08.734414 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":272,"threads_started":1}
W20260808 08:41:08.735222 30941 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:35585 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:08.738479 31054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:08.737611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.194:56101)
0808 08:41:08.738128 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:08.738277 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":275,"threads_started":1}
W20260808 08:41:08.738946 30727 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:35585 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:08.745172 31056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:08.744288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.193:60549)
0808 08:41:08.744779 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:08.744937 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":245,"threads_started":1}
W20260808 08:41:08.745592 30511 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:35585 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:09.261103 31058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc5386c578ab40328a4c15e4bad3a9f0)
I20260808 08:41:09.261451 31058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } }
I20260808 08:41:09.262969 31058 leader_election.cc:288] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc5386c578ab40328a4c15e4bad3a9f0 (127.19.242.254:35585), 11d808a57d2b44da9ef49c4d53c5c2e3 (127.19.242.253:45077)
I20260808 08:41:09.265369 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.263208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49668)
0808 08:41:09.264634 (+ 1426us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.265053 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1255,"thread_start_us":1109,"threads_started":1}
W20260808 08:41:09.265686 30210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:09.267441 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.267029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49676)
0808 08:41:09.267191 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.267283 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:41:09.267706 30210 leader_election.cc:334] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc5386c578ab40328a4c15e4bad3a9f0 (127.19.242.254:35585): Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:09.271050 31062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.263442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34824 (local address 127.19.242.253:45077)
0808 08:41:09.264106 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.264111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.265409 (+ 1298us) server_negotiation.cc:407] Connection header received
0808 08:41:09.265635 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.265640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.265719 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.265835 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:09.266429 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.267416 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.269187 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.270048 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.270194 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.270251 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.270567 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.270696 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":293,"threads_started":1}
I20260808 08:41:09.271270 31060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.263308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:45077 (local address 127.0.0.1:34824)
0808 08:41:09.265283 (+ 1975us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.265304 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:09.265453 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:09.265867 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:09.265873 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:09.265916 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:09.266247 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.266256 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.267660 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.267665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.269013 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.269028 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.270224 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.270229 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.270366 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.270392 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:41:09.270476 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 08:41:09.270605 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1882,"thread_start_us":1438,"threads_started":1}
I20260808 08:41:09.272188 29967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8adabf39b3464902b9752bfe5ad40e68" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" is_pre_election: true
I20260808 08:41:09.273208 30214 leader_election.cc:302] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8adabf39b3464902b9752bfe5ad40e68; no voters: 11d808a57d2b44da9ef49c4d53c5c2e3, fc5386c578ab40328a4c15e4bad3a9f0
I20260808 08:41:09.273615 31058 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:41:09.283787 31064 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc5386c578ab40328a4c15e4bad3a9f0)
I20260808 08:41:09.284129 31064 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } }
I20260808 08:41:09.285591 31064 leader_election.cc:288] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc5386c578ab40328a4c15e4bad3a9f0 (127.19.242.254:35585), 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252:35639)
I20260808 08:41:09.287098 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.285831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49686)
0808 08:41:09.286411 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.286610 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":290,"threads_started":1}
W20260808 08:41:09.287474 29940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:09.289520 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.289026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49702)
0808 08:41:09.289196 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.289345 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 08:41:09.289780 29940 leader_election.cc:334] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fc5386c578ab40328a4c15e4bad3a9f0 (127.19.242.254:35585): Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:09.293874 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.286627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:35639 (local address 127.0.0.1:44050)
0808 08:41:09.287425 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.287452 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:09.287634 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:09.288391 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:09.288397 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:09.288436 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:09.288784 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.288798 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.290242 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.290247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.291663 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.291680 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.293151 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.293157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.293376 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.293406 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:41:09.293519 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:41:09.293643 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":462,"threads_started":1}
I20260808 08:41:09.294051 31070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.286858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.19.242.252:35639)
0808 08:41:09.287962 (+ 1104us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.287971 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.288005 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:41:09.288108 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.288115 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.288203 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.288344 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:09.289012 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.290049 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.291882 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.292769 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.292931 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.292991 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.293575 (+ 584us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.293698 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":937,"thread_start_us":738,"threads_started":1}
I20260808 08:41:09.294849 30245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8adabf39b3464902b9752bfe5ad40e68" is_pre_election: true
I20260808 08:41:09.295245 30245 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d808a57d2b44da9ef49c4d53c5c2e3 in term 1.
I20260808 08:41:09.295926 29940 leader_election.cc:302] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d808a57d2b44da9ef49c4d53c5c2e3, 8adabf39b3464902b9752bfe5ad40e68; no voters: fc5386c578ab40328a4c15e4bad3a9f0
I20260808 08:41:09.296366 31064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 08:41:09.296523 31064 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc5386c578ab40328a4c15e4bad3a9f0)
I20260808 08:41:09.296671 31064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:41:09.299767 31064 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } }
I20260808 08:41:09.300835 31064 leader_election.cc:288] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [CANDIDATE]: Term 2 election: Requested vote from peers fc5386c578ab40328a4c15e4bad3a9f0 (127.19.242.254:35585), 8adabf39b3464902b9752bfe5ad40e68 (127.19.242.252:35639)
I20260808 08:41:09.301458 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.300934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49724)
0808 08:41:09.301155 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.301277 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 08:41:09.301627 30245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8adabf39b3464902b9752bfe5ad40e68"
I20260808 08:41:09.301980 30245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:41:09.302754 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.302359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49740)
0808 08:41:09.302501 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.302593 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:41:09.302991 29940 leader_election.cc:334] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fc5386c578ab40328a4c15e4bad3a9f0 (127.19.242.254:35585): Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
I20260808 08:41:09.304593 30245 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d808a57d2b44da9ef49c4d53c5c2e3 in term 2.
I20260808 08:41:09.305085 29940 leader_election.cc:302] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d808a57d2b44da9ef49c4d53c5c2e3, 8adabf39b3464902b9752bfe5ad40e68; no voters: fc5386c578ab40328a4c15e4bad3a9f0
I20260808 08:41:09.305482 31064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:41:09.305976 31064 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [term 2 LEADER]: Becoming Leader. State: Replica: 11d808a57d2b44da9ef49c4d53c5c2e3, State: Running, Role: LEADER
I20260808 08:41:09.306380 31064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } }
I20260808 08:41:09.308144 31072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11d808a57d2b44da9ef49c4d53c5c2e3. Latest consensus state: current_term: 2 leader_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:09.308771 31072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:09.309651 31076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:09.313966 31076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:09.315037 31076 catalog_manager.cc:1259] Loaded cluster ID: 393093ccd3814d2c97b2e402dbbd8458
I20260808 08:41:09.315146 31076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:09.316547 31076 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:09.317469 31076 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Loaded TSK: 0
I20260808 08:41:09.318444 31076 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:41:09.359469 29957 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34814:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:41:09.369107 29957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:09.374328 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.373806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49768)
0808 08:41:09.373986 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.374119 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:41:09.374892 30245 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [term 2 FOLLOWER]: Refusing update from remote peer 11d808a57d2b44da9ef49c4d53c5c2e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 08:41:09.375720 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.375222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49776)
0808 08:41:09.375424 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.375528 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 08:41:09.375792 31064 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 08:41:09.376150 29940 consensus_peers.cc:487] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 -> Peer fc5386c578ab40328a4c15e4bad3a9f0 (127.19.242.254:35585): Couldn't send request to peer fc5386c578ab40328a4c15e4bad3a9f0. Status: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 08:41:09.379092 31058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11d808a57d2b44da9ef49c4d53c5c2e3. Latest consensus state: current_term: 2 leader_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:09.379364 31058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:41:09.381186 31064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:09.381592 31064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:09.382025 31058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fc5386c578ab40328a4c15e4bad3a9f0" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35585 } } peers { permanent_uuid: "11d808a57d2b44da9ef49c4d53c5c2e3" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 45077 } attrs { promote: false } } peers { permanent_uuid: "8adabf39b3464902b9752bfe5ad40e68" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 35639 } attrs { promote: false } } }
I20260808 08:41:09.382332 31058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adabf39b3464902b9752bfe5ad40e68 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:41:09.407778 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.397006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:40985 (local address 127.0.0.1:33070)
0808 08:41:09.397176 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.397196 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:09.397293 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:09.398531 (+ 1238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:09.398537 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:09.398565 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:09.398821 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.398836 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.401123 (+ 2287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.401132 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.403974 (+ 2842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.404005 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.406504 (+ 2499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.406515 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.406874 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.406944 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 08:41:09.407046 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:41:09.407270 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 08:41:09.409930 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.397161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33070 (local address 127.19.242.194:40985)
0808 08:41:09.397760 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.397766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.397788 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:41:09.397875 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.397880 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.397968 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.398108 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:09.399032 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.400897 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.404414 (+ 3517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.406174 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.408913 (+ 2739us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.409046 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.409120 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.409341 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"spinlock_wait_cycles":1792,"thread_start_us":429,"threads_started":1}
I20260808 08:41:09.411015 30631 tablet_service.cc:1467] Processing CreateTablet for tablet da423ca2a3f14ea186c469167b4abab2 (DEFAULT_TABLE table=test-table [id=fc1457e0175e4665bfa68b528234e2d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:09.411679 30631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da423ca2a3f14ea186c469167b4abab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:09.418516 31066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.398974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:32907 (local address 127.0.0.1:34378)
0808 08:41:09.408167 (+ 9193us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.408196 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:09.408375 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:09.411024 (+ 2649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:09.411033 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:09.411081 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:09.411393 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.411409 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.413067 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.413074 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.415375 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.415397 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.417474 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.417483 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.417766 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.417814 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 08:41:09.417913 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:41:09.418103 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9039,"thread_start_us":9977,"threads_started":1}
I20260808 08:41:09.419677 31088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.399064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34378 (local address 127.19.242.193:32907)
0808 08:41:09.410595 (+ 11531us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.410603 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.410627 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:41:09.410734 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.410740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.410847 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.410976 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:09.411573 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.412878 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.415675 (+ 2797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.417217 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.418913 (+ 1696us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.419015 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.419086 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.419286 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11365,"thread_start_us":12087,"threads_started":1}
I20260808 08:41:09.420428 31089 tablet_bootstrap.cc:492] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: Bootstrap starting.
I20260808 08:41:09.420871 30403 tablet_service.cc:1467] Processing CreateTablet for tablet da423ca2a3f14ea186c469167b4abab2 (DEFAULT_TABLE table=test-table [id=fc1457e0175e4665bfa68b528234e2d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:09.421409 30403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da423ca2a3f14ea186c469167b4abab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:09.423193 31089 tablet_bootstrap.cc:654] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:09.426429 31089 tablet_bootstrap.cc:492] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: No bootstrap required, opened a new log
I20260808 08:41:09.426654 31089 ts_tablet_manager.cc:1397] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:41:09.428427 31091 tablet_bootstrap.cc:492] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: Bootstrap starting.
I20260808 08:41:09.428907 31089 raft_consensus.cc:348] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.429203 31089 raft_consensus.cc:374] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:09.429710 31089 raft_consensus.cc:729] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4f56bcae994400c89614373615de47a, State: Initialized, Role: FOLLOWER
I20260808 08:41:09.430058 31089 consensus_queue.cc:260] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.430606 31091 tablet_bootstrap.cc:654] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:09.433122 31089 ts_tablet_manager.cc:1428] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260808 08:41:09.435416 30728 heartbeater.cc:503] Master 127.19.242.253:45077 was elected leader, sending a full tablet report...
I20260808 08:41:09.436049 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.398341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38867 (local address 127.0.0.1:56448)
0808 08:41:09.398528 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.398557 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:09.398682 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:09.428514 (+ 29832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:09.428520 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:09.428558 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:09.428867 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.428878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.430353 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.430367 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.432454 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.432471 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.434880 (+ 2409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.434891 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.435178 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.435237 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 08:41:09.435365 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 08:41:09.435578 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:41:09.436975 31086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.398504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56448 (local address 127.19.242.195:38867)
0808 08:41:09.428063 (+ 29559us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.428070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.428104 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:41:09.428186 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.428191 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.428315 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.429134 (+ 819us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:09.429361 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.430186 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.432712 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.434258 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.434494 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.434624 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.436305 (+ 1681us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.436542 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29385,"thread_start_us":29248,"threads_started":1}
I20260808 08:41:09.438005 30838 tablet_service.cc:1467] Processing CreateTablet for tablet da423ca2a3f14ea186c469167b4abab2 (DEFAULT_TABLE table=test-table [id=fc1457e0175e4665bfa68b528234e2d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:09.438808 30838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da423ca2a3f14ea186c469167b4abab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:09.439931 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.433244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.194:55659)
0808 08:41:09.439360 (+ 6116us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.439598 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5941,"thread_start_us":5773,"threads_started":1}
I20260808 08:41:09.441322 31091 tablet_bootstrap.cc:492] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: No bootstrap required, opened a new log
I20260808 08:41:09.441498 31091 ts_tablet_manager.cc:1397] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260808 08:41:09.441519 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.441022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.194:56315)
0808 08:41:09.441273 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.441369 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260808 08:41:09.442431 31091 raft_consensus.cc:348] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.442698 31091 raft_consensus.cc:374] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:09.442845 31091 raft_consensus.cc:729] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e63794ec66c43b0ae08bdffd18aaf5b, State: Initialized, Role: FOLLOWER
I20260808 08:41:09.443146 31091 consensus_queue.cc:260] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.444033 31091 ts_tablet_manager.cc:1428] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 08:41:09.445403 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.444346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.193:41977)
0808 08:41:09.444948 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.445155 (+ 207us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":335,"threads_started":1}
I20260808 08:41:09.446353 30512 heartbeater.cc:503] Master 127.19.242.253:45077 was elected leader, sending a full tablet report...
I20260808 08:41:09.446496 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.446047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.193:57577)
0808 08:41:09.446196 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.446290 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 08:41:09.448221 31099 tablet_bootstrap.cc:492] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: Bootstrap starting.
I20260808 08:41:09.450078 31099 tablet_bootstrap.cc:654] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:09.452178 31099 tablet_bootstrap.cc:492] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: No bootstrap required, opened a new log
I20260808 08:41:09.452312 31099 ts_tablet_manager.cc:1397] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:41:09.452941 31099 raft_consensus.cc:348] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.453191 31099 raft_consensus.cc:374] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:09.453258 31099 raft_consensus.cc:729] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293082b145e34462951edfc51cf50f98, State: Initialized, Role: FOLLOWER
I20260808 08:41:09.453466 31099 consensus_queue.cc:260] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.454200 31099 ts_tablet_manager.cc:1428] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:41:09.455761 31105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.454628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.195:37561)
0808 08:41:09.455350 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.455480 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":386,"threads_started":1}
I20260808 08:41:09.457185 30944 heartbeater.cc:503] Master 127.19.242.253:45077 was elected leader, sending a full tablet report...
I20260808 08:41:09.457581 31105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.457042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.195:44443)
0808 08:41:09.457272 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.457393 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260808 08:41:09.497802 31092 raft_consensus.cc:482] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:09.498140 31092 raft_consensus.cc:504] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.500126 31092 leader_election.cc:288] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867), 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907)
I20260808 08:41:09.506531 31096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.500395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:32907 (local address 127.19.242.194:42583)
0808 08:41:09.500835 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.500858 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:09.501067 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:09.501453 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:09.501458 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:09.501501 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:09.501863 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.501873 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.502965 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.502972 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.504458 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.504473 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.505630 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.505636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.505833 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.505900 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 08:41:09.506006 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:41:09.506182 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"spinlock_wait_cycles":7424}
I20260808 08:41:09.506527 31088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.500692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:42583 (local address 127.19.242.193:32907)
0808 08:41:09.500882 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.500891 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.500939 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:41:09.501254 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.501259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.501322 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.501430 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:09.502031 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.502830 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.504641 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.505431 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.505623 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.505703 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.506088 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.506253 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:41:09.506776 31086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.500488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:56195 (local address 127.19.242.195:38867)
0808 08:41:09.500760 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.500770 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.501466 (+ 696us) server_negotiation.cc:407] Connection header received
0808 08:41:09.501689 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.501695 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.501780 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.501883 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:09.502410 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.503207 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.504927 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.505704 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.505899 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.505980 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.506352 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.506486 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:41:09.507558 31106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.500464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:38867 (local address 127.19.242.194:56195)
0808 08:41:09.501338 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.501354 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:09.501536 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:09.501900 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:09.501905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:09.501928 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:09.502247 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.502256 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.503358 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.503363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.504761 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:09.504774 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.505942 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.505949 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:09.506160 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.506193 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:41:09.507019 (+ 826us) client_negotiation.cc:240] Negotiation successful
0808 08:41:09.507141 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":4,"spinlock_wait_cycles":2816,"thread_start_us":569,"threads_started":1}
I20260808 08:41:09.507778 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da423ca2a3f14ea186c469167b4abab2" candidate_uuid: "c4f56bcae994400c89614373615de47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" is_pre_election: true
I20260808 08:41:09.508324 30443 raft_consensus.cc:2454] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4f56bcae994400c89614373615de47a in term 0.
I20260808 08:41:09.508334 30869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da423ca2a3f14ea186c469167b4abab2" candidate_uuid: "c4f56bcae994400c89614373615de47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293082b145e34462951edfc51cf50f98" is_pre_election: true
I20260808 08:41:09.508687 30869 raft_consensus.cc:2454] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4f56bcae994400c89614373615de47a in term 0.
I20260808 08:41:09.509025 30564 leader_election.cc:302] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e63794ec66c43b0ae08bdffd18aaf5b, c4f56bcae994400c89614373615de47a; no voters:
I20260808 08:41:09.509552 31092 raft_consensus.cc:2781] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:09.509704 31092 raft_consensus.cc:482] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:09.509799 31092 raft_consensus.cc:3037] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:09.512333 31092 raft_consensus.cc:504] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.513073 31092 leader_election.cc:288] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [CANDIDATE]: Term 1 election: Requested vote from peers 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867), 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907)
I20260808 08:41:09.513643 30869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da423ca2a3f14ea186c469167b4abab2" candidate_uuid: "c4f56bcae994400c89614373615de47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293082b145e34462951edfc51cf50f98"
I20260808 08:41:09.513698 30443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da423ca2a3f14ea186c469167b4abab2" candidate_uuid: "c4f56bcae994400c89614373615de47a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b"
I20260808 08:41:09.513906 30869 raft_consensus.cc:3037] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:09.513911 30443 raft_consensus.cc:3037] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:09.516484 30443 raft_consensus.cc:2454] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4f56bcae994400c89614373615de47a in term 1.
I20260808 08:41:09.516563 30869 raft_consensus.cc:2454] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4f56bcae994400c89614373615de47a in term 1.
I20260808 08:41:09.517030 30564 leader_election.cc:302] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e63794ec66c43b0ae08bdffd18aaf5b, c4f56bcae994400c89614373615de47a; no voters:
I20260808 08:41:09.517431 31092 raft_consensus.cc:2781] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:09.517928 31092 raft_consensus.cc:686] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 1 LEADER]: Becoming Leader. State: Replica: c4f56bcae994400c89614373615de47a, State: Running, Role: LEADER
I20260808 08:41:09.518390 31092 consensus_queue.cc:237] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } }
I20260808 08:41:09.519156 31106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.518603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.194:41931)
0808 08:41:09.518849 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.519013 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:41:09.522203 29956 catalog_manager.cc:5495] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a reported cstate change: term changed from 0 to 1, leader changed from <none> to c4f56bcae994400c89614373615de47a (127.19.242.194). New cstate: current_term: 1 leader_uuid: "c4f56bcae994400c89614373615de47a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4f56bcae994400c89614373615de47a" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 40985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 } health_report { overall_health: UNKNOWN } } }
I20260808 08:41:09.566383 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.559649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33084 (local address 127.19.242.194:40985)
0808 08:41:09.559917 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.559923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.560087 (+ 164us) server_negotiation.cc:407] Connection header received
0808 08:41:09.560264 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.560268 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.560355 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.560488 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:09.560872 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.561685 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.563761 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.564403 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.564543 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.565089 (+ 546us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:09.565757 (+ 668us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:09.565876 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.566085 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.566167 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:41:09.571244 30869 raft_consensus.cc:1261] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Refusing update from remote peer c4f56bcae994400c89614373615de47a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:09.571578 30443 raft_consensus.cc:1261] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 FOLLOWER]: Refusing update from remote peer c4f56bcae994400c89614373615de47a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:09.572103 31107 consensus_queue.cc:1035] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "293082b145e34462951edfc51cf50f98" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 38867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:09.572620 31092 consensus_queue.cc:1035] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e63794ec66c43b0ae08bdffd18aaf5b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 32907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:09.575785 31105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.575176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.195:43739)
0808 08:41:09.575440 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.575560 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260808 08:41:09.576010 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.575399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.193:49177)
0808 08:41:09.575625 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.575782 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:41:09.587127 31098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.586538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.193:43489)
0808 08:41:09.586833 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.586940 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
I20260808 08:41:09.587533 31106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.586588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.194:59069)
0808 08:41:09.587149 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.587282 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405}
I20260808 08:41:09.588172 31105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.586814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.19.242.195:38469)
0808 08:41:09.587886 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.587991 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":910}
I20260808 08:41:09.594065 31111 mvcc.cc:205] Tried to move back new op lower bound from 7316187011355844608 to 7316187011152084992. Current Snapshot: MvccSnapshot[applied={T|T < 7316187011355844608 or (T in {7316187011355844608})}]
I20260808 08:41:09.600981 29957 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:09.601296 29957 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:09.609234 29957 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 11d808a57d2b44da9ef49c4d53c5c2e3: Sending DeleteTablet for 3 replicas of tablet da423ca2a3f14ea186c469167b4abab2
I20260808 08:41:09.610198 30631 tablet_service.cc:1514] Processing DeleteTablet for tablet da423ca2a3f14ea186c469167b4abab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:09 UTC) from {username='oryx', principal='oryx/127.19.242.253@KRBTEST.COM'} at 127.0.0.1:33070
I20260808 08:41:09.610275 30403 tablet_service.cc:1514] Processing DeleteTablet for tablet da423ca2a3f14ea186c469167b4abab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:09 UTC) from {username='oryx', principal='oryx/127.19.242.253@KRBTEST.COM'} at 127.0.0.1:34378
I20260808 08:41:09.610745 30838 tablet_service.cc:1514] Processing DeleteTablet for tablet da423ca2a3f14ea186c469167b4abab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:09 UTC) from {username='oryx', principal='oryx/127.19.242.253@KRBTEST.COM'} at 127.0.0.1:56448
I20260808 08:41:09.612293 30402 tablet_service.cc:1514] Processing DeleteTablet for tablet da423ca2a3f14ea186c469167b4abab2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:09 UTC) from {username='oryx', principal='oryx/127.19.242.253@KRBTEST.COM'} at 127.0.0.1:34378
I20260808 08:41:09.615200 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 30197
I20260808 08:41:09.620023 31130 tablet_replica.cc:330] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: stopping tablet replica
I20260808 08:41:09.621133 31130 raft_consensus.cc:2229] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:09.622103 31130 raft_consensus.cc:2258] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:09.624783 31125 tablet_replica.cc:330] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: stopping tablet replica
I20260808 08:41:09.625023 31130 ts_tablet_manager.cc:1905] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:09.625012 31125 raft_consensus.cc:2229] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:41:09.625754 31125 raft_consensus.cc:2258] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:09.627051 31125 ts_tablet_manager.cc:1905] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:09.628997 31121 tablet_replica.cc:330] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: stopping tablet replica
I20260808 08:41:09.629300 31121 raft_consensus.cc:2229] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:09.630138 31121 raft_consensus.cc:2258] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:09.631668 31121 ts_tablet_manager.cc:1905] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:09.634851 31130 ts_tablet_manager.cc:1918] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:09.635041 31130 log.cc:1196] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/da423ca2a3f14ea186c469167b4abab2
I20260808 08:41:09.635494 31130 ts_tablet_manager.cc:1939] T da423ca2a3f14ea186c469167b4abab2 P 293082b145e34462951edfc51cf50f98: Deleting consensus metadata
I20260808 08:41:09.636240 31125 ts_tablet_manager.cc:1918] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:09.636415 31125 log.cc:1196] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/da423ca2a3f14ea186c469167b4abab2
I20260808 08:41:09.636991 31125 ts_tablet_manager.cc:1939] T da423ca2a3f14ea186c469167b4abab2 P c4f56bcae994400c89614373615de47a: Deleting consensus metadata
I20260808 08:41:09.636982 29938 catalog_manager.cc:4841] TS 293082b145e34462951edfc51cf50f98 (127.19.242.195:38867): tablet da423ca2a3f14ea186c469167b4abab2 (table test-table [id=fc1457e0175e4665bfa68b528234e2d9]) successfully deleted
I20260808 08:41:09.638352 29938 catalog_manager.cc:4841] TS c4f56bcae994400c89614373615de47a (127.19.242.194:40985): tablet da423ca2a3f14ea186c469167b4abab2 (table test-table [id=fc1457e0175e4665bfa68b528234e2d9]) successfully deleted
I20260808 08:41:09.639997 31121 ts_tablet_manager.cc:1918] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:09.640236 31121 log.cc:1196] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/da423ca2a3f14ea186c469167b4abab2
I20260808 08:41:09.642081 31121 ts_tablet_manager.cc:1939] T da423ca2a3f14ea186c469167b4abab2 P 9e63794ec66c43b0ae08bdffd18aaf5b: Deleting consensus metadata
I20260808 08:41:09.643584 29941 catalog_manager.cc:4841] TS 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907): tablet da423ca2a3f14ea186c469167b4abab2 (table test-table [id=fc1457e0175e4665bfa68b528234e2d9]) successfully deleted
W20260808 08:41:09.644066 29941 catalog_manager.cc:4808] TS 9e63794ec66c43b0ae08bdffd18aaf5b (127.19.242.193:32907): delete failed for tablet da423ca2a3f14ea186c469167b4abab2 because the tablet was not found. No further retry: Not found: Tablet not found: da423ca2a3f14ea186c469167b4abab2
I20260808 08:41:09.648029 31088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.616669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.19.242.193:32907)
0808 08:41:09.617299 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.617306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.620665 (+ 3359us) server_negotiation.cc:407] Connection header received
0808 08:41:09.620764 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.620771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.620887 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.621008 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:09.624309 (+ 3301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.625525 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.627726 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.628415 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.628567 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.640563 (+ 11996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:09.640587 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:09.640613 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:09.640680 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:09.644823 (+ 4143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:09.645656 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:09.645667 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:09.645678 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:09.645820 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:09.646272 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:09.646278 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:09.646281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:09.646664 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:09.647049 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.647421 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.647664 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477}
I20260808 08:41:09.648829 30499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:09.776786 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 30197
I20260808 08:41:09.813577 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 30526
I20260808 08:41:09.828663 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.828206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49782)
0808 08:41:09.828397 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.828508 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:41:09.830032 31067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.829525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35585 (local address 127.0.0.1:49786)
0808 08:41:09.829782 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:09.829875 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:35585: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 08:41:09.831704 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.814434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33086 (local address 127.19.242.194:40985)
0808 08:41:09.814630 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.814635 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.814770 (+ 135us) server_negotiation.cc:407] Connection header received
0808 08:41:09.814929 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.814933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.815031 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.815116 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:09.816950 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.817927 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.819805 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.820230 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.820335 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.823957 (+ 3622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:09.823970 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:09.823985 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:09.824039 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:09.827746 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:09.828921 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:09.828938 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:09.828942 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:09.829164 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:09.829635 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:09.829640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:09.829643 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:09.830217 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:09.830571 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.831067 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.831325 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:41:09.832446 30719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:09.955648 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 30526
I20260808 08:41:09.982417 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 30743
I20260808 08:41:09.998693 31086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:09.983427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56454 (local address 127.19.242.195:38867)
0808 08:41:09.983656 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:09.983661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:09.983682 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:41:09.983823 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:09.983827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:09.983904 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:09.984053 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:09.985729 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.986491 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.988041 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:09.988484 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:09.988653 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:09.991400 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:09.991416 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:09.991436 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:09.991482 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:09.995282 (+ 3800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:09.996182 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:09.996191 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:09.996194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:09.996434 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:09.996892 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:09.996895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:09.996897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:09.997370 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:09.997725 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:09.998066 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 08:41:09.998293 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:41:09.999704 30930 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:10.104746 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 30743
I20260808 08:41:10.136554 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 29747
I20260808 08:41:10.137732 30008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:10.263013 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 29747
W20260808 08:41:10.292757 30208 connection.cc:535] server connection from 127.0.0.1:44050 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:41:10.293208 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 29911
I20260808 08:41:10.294447 30276 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:10.414889 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 29911
2026-08-08T08:41:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11008 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:41:10 dist-test-slave-39l8 krb5kdc[31139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:41:10 dist-test-slave-39l8 krb5kdc[31139](info): set up 2 sockets
Aug 08 08:41:10 dist-test-slave-39l8 krb5kdc[31139](info): commencing operation
krb5kdc: starting...
W20260808 08:41:11.866189 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.392s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:41:12 dist-test-slave-39l8 krb5kdc[31139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:41:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:12Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab.
Entry for principal oryx/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab.
I20260808 08:41:12.176566 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33165
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab
--principal=oryx/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:33165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:12.540352 31157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:12.540697 31157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:12.540868 31157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:12.548477 31157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:12.548606 31157 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:41:12.548651 31157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:12.548779 31157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:12.548848 31157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:12.548939 31157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:12.559337 31157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:33165
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.254.keytab
--principal=oryx/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:12.560774 31157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:12.562187 31157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:12.575426 31164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:12.575362 31167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:12.575462 31165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:12.576391 31157 server_base.cc:1034] running on GCE node
I20260808 08:41:12.577344 31157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:12.579098 31157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:12.580400 31157 hybrid_clock.cc:648] HybridClock initialized: now 1786178472580338 us; error 48 us; skew 500 ppm
I20260808 08:41:12.580832 31157 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:12 dist-test-slave-39l8 krb5kdc[31139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178472, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:12.584524 31157 init.cc:377] Logged in from keytab as oryx/127.19.242.254@KRBTEST.COM (short username oryx)
I20260808 08:41:12.586352 31157 webserver.cc:460] Webserver started at http://127.19.242.254:40835/ using document root <none> and password file <none>
I20260808 08:41:12.587265 31157 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:12.587435 31157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:12.587802 31157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:12.591140 31157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "e687689aca934fafa4dfc8542f2970f5"
format_stamp: "Formatted at 2026-08-08 08:41:12 on dist-test-slave-39l8"
server_key: "940d080510c9674215967af9ed73606b"
server_key_iv: "cbb5b8a26b0599f88d123b322c50d9d4"
server_key_version: "encryptionkey@0"
I20260808 08:41:12.592092 31157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "e687689aca934fafa4dfc8542f2970f5"
format_stamp: "Formatted at 2026-08-08 08:41:12 on dist-test-slave-39l8"
server_key: "940d080510c9674215967af9ed73606b"
server_key_iv: "cbb5b8a26b0599f88d123b322c50d9d4"
server_key_version: "encryptionkey@0"
I20260808 08:41:12.598289 31157 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:41:12.603070 31180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:12.604828 31157 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:41:12.605113 31157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "e687689aca934fafa4dfc8542f2970f5"
format_stamp: "Formatted at 2026-08-08 08:41:12 on dist-test-slave-39l8"
server_key: "940d080510c9674215967af9ed73606b"
server_key_iv: "cbb5b8a26b0599f88d123b322c50d9d4"
server_key_version: "encryptionkey@0"
I20260808 08:41:12.605422 31157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:12.632040 31157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:12.637180 31157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:12.637557 31157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:12.663084 31157 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:33165
I20260808 08:41:12.663106 31271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:33165 every 8 connection(s)
I20260808 08:41:12.664723 31157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:41:12.668771 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 31157
I20260808 08:41:12.669037 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:41:12.669538 31272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:12.669937 20427 external_mini_cluster.cc:1428] Setting key be27222f3ae34d683fbc50d3c7594a41
I20260808 08:41:12.686098 31272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Bootstrap starting.
Aug 08 08:41:12 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178472, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:12.690735 31272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:12.692368 31272 log.cc:824] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:12.696538 31272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: No bootstrap required, opened a new log
I20260808 08:41:12.697599 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:12.672245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.19.242.254:33165)
0808 08:41:12.673180 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:12.673197 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:12.673244 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:41:12.675074 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:12.675101 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:12.675579 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:12.675956 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:12.677950 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:12.679410 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:12.681333 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:12.682108 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:12.682278 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:12.687549 (+ 5271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:12.687564 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:12.687587 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:12.687655 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:12.692055 (+ 4400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:12.693070 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:12.693081 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:12.693090 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:12.693359 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:12.693909 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:12.693914 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:12.693916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:12.694804 (+ 888us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:12.695131 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:12.695602 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 08:41:12.696083 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":456,"threads_started":1}
I20260808 08:41:12.705986 31272 raft_consensus.cc:348] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e687689aca934fafa4dfc8542f2970f5" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33165 } }
I20260808 08:41:12.706385 31272 raft_consensus.cc:374] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:12.706470 31272 raft_consensus.cc:729] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e687689aca934fafa4dfc8542f2970f5, State: Initialized, Role: FOLLOWER
I20260808 08:41:12.707134 31272 consensus_queue.cc:260] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e687689aca934fafa4dfc8542f2970f5" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33165 } }
I20260808 08:41:12.707373 31272 raft_consensus.cc:388] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:41:12.707481 31272 raft_consensus.cc:482] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:41:12.707616 31272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:12.710319 31272 raft_consensus.cc:504] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e687689aca934fafa4dfc8542f2970f5" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33165 } }
I20260808 08:41:12.710916 31272 leader_election.cc:302] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e687689aca934fafa4dfc8542f2970f5; no voters:
I20260808 08:41:12.711585 31272 leader_election.cc:288] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:41:12.711812 31279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:12.712615 31279 raft_consensus.cc:686] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [term 1 LEADER]: Becoming Leader. State: Replica: e687689aca934fafa4dfc8542f2970f5, State: Running, Role: LEADER
I20260808 08:41:12.713202 31279 consensus_queue.cc:237] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e687689aca934fafa4dfc8542f2970f5" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33165 } }
I20260808 08:41:12.713930 31272 sys_catalog.cc:564] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:12.716182 31280 sys_catalog.cc:455] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e687689aca934fafa4dfc8542f2970f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e687689aca934fafa4dfc8542f2970f5" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33165 } } }
I20260808 08:41:12.716598 31280 sys_catalog.cc:458] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:12.717525 31281 sys_catalog.cc:455] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e687689aca934fafa4dfc8542f2970f5. Latest consensus state: current_term: 1 leader_uuid: "e687689aca934fafa4dfc8542f2970f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e687689aca934fafa4dfc8542f2970f5" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33165 } } }
I20260808 08:41:12.719029 31281 sys_catalog.cc:458] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:12.719074 31287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:12.724875 31287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:12.734999 31287 catalog_manager.cc:1347] Generated new cluster ID: 45d3e741d62b46b09c76c634f451980d
I20260808 08:41:12.735146 31287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:12.758266 31287 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:41:12.759855 31287 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:12.775626 31287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Generated new TSK 0
I20260808 08:41:12.776588 31287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab.
Entry for principal oryx/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab.
I20260808 08:41:12.862362 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33165
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab
--principal=oryx/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:13.251941 31311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:13.252314 31311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:13.252420 31311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:13.260270 31311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:13.260417 31311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:13.260506 31311 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:41:13.260586 31311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:13.270996 31311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab
--principal=oryx/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:33165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:13.272406 31311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:13.273852 31311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:13.289004 31318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:13.289062 31319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:13.289116 31325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:13.290099 31311 server_base.cc:1034] running on GCE node
I20260808 08:41:13.290994 31311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:13.292157 31311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:13.293473 31311 hybrid_clock.cc:648] HybridClock initialized: now 1786178473293379 us; error 69 us; skew 500 ppm
I20260808 08:41:13.293862 31311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:13 dist-test-slave-39l8 krb5kdc[31139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178473, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:13.297736 31311 init.cc:377] Logged in from keytab as oryx/127.19.242.193@KRBTEST.COM (short username oryx)
I20260808 08:41:13.299715 31311 webserver.cc:460] Webserver started at http://127.19.242.193:46579/ using document root <none> and password file <none>
I20260808 08:41:13.300624 31311 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:13.300848 31311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:13.301205 31311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:13.304762 31311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "30a57fcbbdfc4019959539782704eb34"
format_stamp: "Formatted at 2026-08-08 08:41:13 on dist-test-slave-39l8"
server_key: "ef8d20dff35e1e87b7742cc37193fde2"
server_key_iv: "345efc2b808355d1bcf5f21faf9a2bef"
server_key_version: "encryptionkey@0"
I20260808 08:41:13.305671 31311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "30a57fcbbdfc4019959539782704eb34"
format_stamp: "Formatted at 2026-08-08 08:41:13 on dist-test-slave-39l8"
server_key: "ef8d20dff35e1e87b7742cc37193fde2"
server_key_iv: "345efc2b808355d1bcf5f21faf9a2bef"
server_key_version: "encryptionkey@0"
I20260808 08:41:13.312362 31311 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 08:41:13.317103 31336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:13.318917 31311 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:41:13.319111 31311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "30a57fcbbdfc4019959539782704eb34"
format_stamp: "Formatted at 2026-08-08 08:41:13 on dist-test-slave-39l8"
server_key: "ef8d20dff35e1e87b7742cc37193fde2"
server_key_iv: "345efc2b808355d1bcf5f21faf9a2bef"
server_key_version: "encryptionkey@0"
I20260808 08:41:13.319407 31311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:13.339986 31311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:13.345084 31311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:13.345438 31311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:13.348832 31311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:13.348975 31311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:13.349231 31311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:13.349345 31311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:41:13 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178473, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:13.376953 31349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.349364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:47229 (local address 127.19.242.254:33165)
0808 08:41:13.350034 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:13.350042 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:13.351377 (+ 1335us) server_negotiation.cc:407] Connection header received
0808 08:41:13.353614 (+ 2237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:13.353621 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:13.353729 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:13.353865 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:13.356326 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.357849 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.360815 (+ 2966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.361453 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.361625 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:13.368443 (+ 6818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:13.368453 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:13.368461 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:13.368519 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:13.372511 (+ 3992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:13.373822 (+ 1311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:13.373832 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:13.373839 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:13.374070 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:13.374919 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:13.374925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:13.374928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:13.375264 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:13.375449 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:13.376302 (+ 853us) server_negotiation.cc:299] Negotiation successful
0808 08:41:13.376568 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":302,"threads_started":1}
I20260808 08:41:13.378238 31351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.350197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33165 (local address 127.19.242.193:47229)
0808 08:41:13.351159 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:13.351213 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:13.353246 (+ 2033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:13.354141 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:13.354152 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:13.355067 (+ 915us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:13.356027 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.356069 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.358126 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.358137 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.360599 (+ 2462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.360622 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.361775 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.361784 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.362208 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:13.363416 (+ 1208us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:13.363442 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:13.367979 (+ 4537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:13.372734 (+ 4755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:13.372748 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:13.372776 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:13.373594 (+ 818us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:13.374253 (+ 659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:13.374265 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:13.374271 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:13.374748 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:13.375422 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:13.375432 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:13.375873 (+ 441us) client_negotiation.cc:769] Sending connection context
0808 08:41:13.376171 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 08:41:13.376802 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":392,"threads_started":1}
I20260808 08:41:13.401453 31311 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:42919
I20260808 08:41:13.401465 31526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:42919 every 8 connection(s)
I20260808 08:41:13.403406 31311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:13.405025 31349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.385332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:36501 (local address 127.19.242.254:33165)
0808 08:41:13.385736 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:13.385740 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:13.386398 (+ 658us) server_negotiation.cc:407] Connection header received
0808 08:41:13.386629 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:13.386633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:13.386794 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:13.386946 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:13.388372 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.389424 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.391421 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.392388 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.392586 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:13.396165 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:13.396177 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:13.396223 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:13.396301 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:13.401025 (+ 4724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:13.402321 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:13.402326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:13.402329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:13.402486 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:13.403071 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:13.403076 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:13.403079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:13.403427 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:13.403707 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:13.404271 (+ 564us) server_negotiation.cc:299] Negotiation successful
0808 08:41:13.404578 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260808 08:41:13.405400 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.385365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33165 (local address 127.19.242.193:36501)
0808 08:41:13.386213 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:13.386251 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:13.386479 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:13.386982 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:13.386987 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:13.387582 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:13.388179 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.388201 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.389635 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.389640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.391210 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.391230 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.392666 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.392676 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.392948 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:13.393831 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:13.393876 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:13.395756 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:13.401314 (+ 5558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:13.401321 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:13.401326 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:13.402119 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:13.402652 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:13.402660 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:13.402664 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:13.402905 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:13.403608 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:13.403616 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:13.403868 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 08:41:13.404083 (+ 215us) client_negotiation.cc:240] Negotiation successful
0808 08:41:13.404631 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":402,"threads_started":1}
I20260808 08:41:13.406386 31527 heartbeater.cc:347] Connected to a master server at 127.19.242.254:33165
I20260808 08:41:13.406736 31527 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:13.407708 31527 heartbeater.cc:511] Master 127.19.242.254:33165 requested a full tablet report, sending...
I20260808 08:41:13.408948 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 31311
I20260808 08:41:13.409215 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:41:13.410208 20427 external_mini_cluster.cc:1428] Setting key c5a70af5d97434ad9d5e06e95bb9d7c8
I20260808 08:41:13.410507 31200 ts_manager.cc:194] Registered new tserver with Master: 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919)
I20260808 08:41:13.412839 31200 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:47229
WARNING: no policy specified for oryx/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab.
Entry for principal oryx/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab.
I20260808 08:41:13.476675 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33165
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab
--principal=oryx/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:13.846168 31535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:13.846594 31535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:13.846854 31535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:13.854466 31535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:13.854614 31535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:13.854796 31535 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:41:13.854895 31535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:13.865427 31535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab
--principal=oryx/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:33165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:13.866983 31535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:13.868479 31535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:13.884312 31544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:13.884279 31547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:13.884387 31543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:13.886089 31535 server_base.cc:1034] running on GCE node
I20260808 08:41:13.886932 31535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:13.888242 31535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:13.889500 31535 hybrid_clock.cc:648] HybridClock initialized: now 1786178473889429 us; error 43 us; skew 500 ppm
I20260808 08:41:13.889861 31535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:13 dist-test-slave-39l8 krb5kdc[31139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178473, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:13.893478 31535 init.cc:377] Logged in from keytab as oryx/127.19.242.194@KRBTEST.COM (short username oryx)
I20260808 08:41:13.895313 31535 webserver.cc:460] Webserver started at http://127.19.242.194:40747/ using document root <none> and password file <none>
I20260808 08:41:13.896157 31535 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:13.896266 31535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:13.896579 31535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:13.899995 31535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
format_stamp: "Formatted at 2026-08-08 08:41:13 on dist-test-slave-39l8"
server_key: "42b893afa96531d3b2a4d8897758d9c8"
server_key_iv: "80df94bafe5dde10514fa7b1be41a5e3"
server_key_version: "encryptionkey@0"
I20260808 08:41:13.901237 31535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
format_stamp: "Formatted at 2026-08-08 08:41:13 on dist-test-slave-39l8"
server_key: "42b893afa96531d3b2a4d8897758d9c8"
server_key_iv: "80df94bafe5dde10514fa7b1be41a5e3"
server_key_version: "encryptionkey@0"
I20260808 08:41:13.907793 31535 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:41:13.912359 31555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:13.914021 31535 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:41:13.914232 31535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
format_stamp: "Formatted at 2026-08-08 08:41:13 on dist-test-slave-39l8"
server_key: "42b893afa96531d3b2a4d8897758d9c8"
server_key_iv: "80df94bafe5dde10514fa7b1be41a5e3"
server_key_version: "encryptionkey@0"
I20260808 08:41:13.914476 31535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:13.943650 31535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:13.948841 31535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:13.949133 31535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:13.952448 31535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:13.952579 31535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:13.952761 31535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:13.952847 31535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:41:13 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178473, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:13.982386 31571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.953855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33165 (local address 127.19.242.194:52911)
0808 08:41:13.954856 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:13.954905 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:13.956980 (+ 2075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:13.957915 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:13.957933 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:13.958980 (+ 1047us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:13.959999 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.960042 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.962040 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.962049 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.964655 (+ 2606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.964678 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.966163 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.966176 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.966548 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:13.967666 (+ 1118us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:13.967699 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:13.972236 (+ 4537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:13.977144 (+ 4908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:13.977163 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:13.977192 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:13.978066 (+ 874us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:13.978646 (+ 580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:13.978657 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:13.978663 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:13.979204 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:13.979899 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:13.979909 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:13.980365 (+ 456us) client_negotiation.cc:769] Sending connection context
0808 08:41:13.980685 (+ 320us) client_negotiation.cc:240] Negotiation successful
0808 08:41:13.981155 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":427,"threads_started":1}
I20260808 08:41:13.983551 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.952986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:52911 (local address 127.19.242.254:33165)
0808 08:41:13.953979 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:13.953984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:13.955045 (+ 1061us) server_negotiation.cc:407] Connection header received
0808 08:41:13.957349 (+ 2304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:13.957355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:13.957459 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:13.957594 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:13.960301 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.961775 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.964887 (+ 3112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.965780 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.965959 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:13.972632 (+ 6673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:13.972638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:13.972642 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:13.972686 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:13.976905 (+ 4219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:13.978253 (+ 1348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:13.978260 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:13.978264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:13.978484 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:13.979394 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:13.979402 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:13.979407 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:13.979732 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:13.979950 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:13.982956 (+ 3006us) server_negotiation.cc:299] Negotiation successful
0808 08:41:13.983245 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":868,"thread_start_us":783,"threads_started":1}
I20260808 08:41:14.009135 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.990083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:52205 (local address 127.19.242.254:33165)
0808 08:41:13.990350 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:13.990359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:13.991495 (+ 1136us) server_negotiation.cc:407] Connection header received
0808 08:41:13.991748 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:13.991752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:13.991828 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:13.991925 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:13.993752 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.994511 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.997772 (+ 3261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.998416 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.998598 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.001624 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:14.001633 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:14.001639 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:14.001691 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:14.005314 (+ 3623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.006471 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.006481 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.006487 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.006758 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.007268 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.007274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.007278 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.007827 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:14.008012 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.008481 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.008747 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:41:14.009248 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:13.990047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33165 (local address 127.19.242.194:52205)
0808 08:41:13.991330 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:13.991358 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:13.991588 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:13.992025 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:13.992033 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:13.992932 (+ 899us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:13.993481 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.993503 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.994747 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.994756 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.997429 (+ 2673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:13.997462 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:13.998679 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:13.998690 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:13.999022 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:13.999919 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:13.999948 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:14.001305 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:14.005506 (+ 4201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:14.005515 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:14.005525 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:14.006255 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:14.006921 (+ 666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:14.006927 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:14.006934 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:14.007092 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:14.007973 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:14.007977 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:14.008187 (+ 210us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.008343 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.008762 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"thread_start_us":851,"threads_started":1}
I20260808 08:41:14.020310 31535 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:37061
I20260808 08:41:14.020344 31723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:37061 every 8 connection(s)
I20260808 08:41:14.022243 31535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:14.025472 31725 heartbeater.cc:347] Connected to a master server at 127.19.242.254:33165
I20260808 08:41:14.025774 31725 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:14.026583 31725 heartbeater.cc:511] Master 127.19.242.254:33165 requested a full tablet report, sending...
I20260808 08:41:14.028275 31200 ts_manager.cc:194] Registered new tserver with Master: 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061)
I20260808 08:41:14.029114 31200 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:52911
I20260808 08:41:14.030691 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 31535
I20260808 08:41:14.031009 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:41:14.031522 20427 external_mini_cluster.cc:1428] Setting key 6892b985834f1bf9988ef2a35d72f3e2
WARNING: no policy specified for oryx/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab.
Entry for principal oryx/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab.
I20260808 08:41:14.099155 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:33165
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab
--principal=oryx/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:14.417313 31527 heartbeater.cc:503] Master 127.19.242.254:33165 was elected leader, sending a full tablet report...
W20260808 08:41:14.465272 31731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:14.465672 31731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:14.465867 31731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:14.473521 31731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:14.473713 31731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:14.473881 31731 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:41:14.474026 31731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:14.484719 31731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab
--principal=oryx/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.242.254:33165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:14.486361 31731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:14.487884 31731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:14.503123 31739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:14.503093 31742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:14.503193 31740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:14.504400 31731 server_base.cc:1034] running on GCE node
I20260808 08:41:14.505151 31731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:14.506229 31731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:14.507534 31731 hybrid_clock.cc:648] HybridClock initialized: now 1786178474507439 us; error 64 us; skew 500 ppm
I20260808 08:41:14.507889 31731 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:14 dist-test-slave-39l8 krb5kdc[31139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178474, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:14.511781 31731 init.cc:377] Logged in from keytab as oryx/127.19.242.195@KRBTEST.COM (short username oryx)
I20260808 08:41:14.513484 31731 webserver.cc:460] Webserver started at http://127.19.242.195:38685/ using document root <none> and password file <none>
I20260808 08:41:14.514254 31731 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:14.514350 31731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:14.514770 31731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:14.517925 31731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "2ef14d1d003c46ad93e1d6ebb082c325"
format_stamp: "Formatted at 2026-08-08 08:41:14 on dist-test-slave-39l8"
server_key: "ee9a17d4d423c8734a38679b6804fa5d"
server_key_iv: "65929bd8004e79dbf70de1a2c62ef890"
server_key_version: "encryptionkey@0"
I20260808 08:41:14.518931 31731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "2ef14d1d003c46ad93e1d6ebb082c325"
format_stamp: "Formatted at 2026-08-08 08:41:14 on dist-test-slave-39l8"
server_key: "ee9a17d4d423c8734a38679b6804fa5d"
server_key_iv: "65929bd8004e79dbf70de1a2c62ef890"
server_key_version: "encryptionkey@0"
I20260808 08:41:14.525170 31731 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:41:14.529281 31752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:14.530982 31731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:14.531201 31731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "2ef14d1d003c46ad93e1d6ebb082c325"
format_stamp: "Formatted at 2026-08-08 08:41:14 on dist-test-slave-39l8"
server_key: "ee9a17d4d423c8734a38679b6804fa5d"
server_key_iv: "65929bd8004e79dbf70de1a2c62ef890"
server_key_version: "encryptionkey@0"
I20260808 08:41:14.531481 31731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:14.547472 31731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:14.552837 31731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:14.553205 31731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:14.556501 31731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:14.556627 31731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:14.556819 31731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:14.556932 31731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:41:14 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178474, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:14.587046 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.557078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:56267 (local address 127.19.242.254:33165)
0808 08:41:14.557965 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.557972 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.559168 (+ 1196us) server_negotiation.cc:407] Connection header received
0808 08:41:14.561475 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.561484 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.561628 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.561777 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:14.564644 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.566085 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.568790 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.569489 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.569693 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.577412 (+ 7719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:14.577423 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:14.577431 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:14.577501 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:14.581757 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.583369 (+ 1612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.583376 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.583378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.583562 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.584307 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.584312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.584314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.584647 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:14.584776 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.586139 (+ 1363us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.586531 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":632,"threads_started":1}
I20260808 08:41:14.589004 31764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.557909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33165 (local address 127.19.242.195:56267)
0808 08:41:14.558938 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:14.558995 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:14.561102 (+ 2107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:14.562152 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:14.562168 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:14.563210 (+ 1042us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:14.564272 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.564330 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.566361 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.566367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.568574 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.568592 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.569869 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.569883 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.570344 (+ 461us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.571425 (+ 1081us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:14.571470 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:14.576913 (+ 5443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:14.581986 (+ 5073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:14.582004 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:14.582037 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:14.583157 (+ 1120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:14.583712 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:14.583721 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:14.583727 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:14.584147 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:14.584809 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:14.584823 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:14.585517 (+ 694us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.585976 (+ 459us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.586862 (+ 886us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":430,"threads_started":1}
I20260808 08:41:14.617020 31889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.599246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33165 (local address 127.19.242.195:52449)
0808 08:41:14.600210 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:14.600245 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:14.600491 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:14.600995 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:14.601000 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:14.601555 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:14.601887 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.601899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.603177 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.603186 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.605004 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.605022 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.605907 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.605916 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.606113 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.607060 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:14.607094 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:14.608405 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:14.613494 (+ 5089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:14.613501 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:14.613506 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:14.614166 (+ 660us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:14.614728 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:14.614738 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:14.614744 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:14.614971 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:14.615888 (+ 917us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:14.615893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:14.616118 (+ 225us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.616266 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.616621 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":477,"threads_started":1}
I20260808 08:41:14.617372 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.598695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:52449 (local address 127.19.242.254:33165)
0808 08:41:14.598970 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.598977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.600412 (+ 1435us) server_negotiation.cc:407] Connection header received
0808 08:41:14.600683 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.600689 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.600797 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.600955 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:14.602082 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.602966 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.605212 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.605671 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.605827 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.608730 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:14.608735 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:14.608739 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:14.608778 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:14.613291 (+ 4513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.614324 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.614331 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.614336 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.614563 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.615150 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.615160 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.615165 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.615712 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:14.615943 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.616475 (+ 532us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.616829 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 08:41:14.623936 31731 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:40395
I20260808 08:41:14.623986 31931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:40395 every 8 connection(s)
I20260808 08:41:14.625417 31731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:14.627897 31932 heartbeater.cc:347] Connected to a master server at 127.19.242.254:33165
I20260808 08:41:14.628185 31932 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:14.628938 31932 heartbeater.cc:511] Master 127.19.242.254:33165 requested a full tablet report, sending...
I20260808 08:41:14.630607 31200 ts_manager.cc:194] Registered new tserver with Master: 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195:40395)
I20260808 08:41:14.631579 31200 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:56267
I20260808 08:41:14.633175 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 31731
I20260808 08:41:14.633387 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:41:14.633885 20427 external_mini_cluster.cc:1428] Setting key c4b03dfefe09e25960124db1422ed077
I20260808 08:41:14.637739 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:41:14 dist-test-slave-39l8 krb5kdc[31139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178474, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:41:14 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:14 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:41:14.707301 31763 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:14.695263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54102 (local address 127.19.242.254:33165)
0808 08:41:14.695521 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.695528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.695826 (+ 298us) server_negotiation.cc:407] Connection header received
0808 08:41:14.696076 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.696081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.696179 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.696304 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:14.697887 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.698655 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.700063 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.700491 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.700648 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.706970 (+ 6322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54102: BlockingRecv error: recv got EOF from 127.0.0.1:54102 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 08 08:41:14 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178474, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:14.727202 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.711219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54116 (local address 127.19.242.254:33165)
0808 08:41:14.711469 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.711478 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.711819 (+ 341us) server_negotiation.cc:407] Connection header received
0808 08:41:14.712068 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.712073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.712159 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.712278 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:14.713603 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.714427 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.715891 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.716384 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.716546 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.721204 (+ 4658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:14.721210 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:14.721215 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:14.721262 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:14.724335 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.725331 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.725336 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.725339 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.725489 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:14.725904 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:14.725907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:14.725909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:14.726207 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:14.726407 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.726699 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.726962 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:41:14.732025 31200 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:41:14.740252 31200 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:14.777565 31970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.754180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41506 (local address 127.19.242.194:37061)
0808 08:41:14.761026 (+ 6846us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.761041 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.767543 (+ 6502us) server_negotiation.cc:407] Connection header received
0808 08:41:14.768039 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.768049 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.768371 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.768553 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:14.769878 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.771493 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.774676 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.776197 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.776421 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.776639 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.777027 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.777214 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6566,"thread_start_us":1469,"threads_started":1}
I20260808 08:41:14.777657 31969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.753990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:37061 (local address 127.0.0.1:41506)
0808 08:41:14.767306 (+ 13316us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:14.767375 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:14.767744 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:14.768891 (+ 1147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:14.768902 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:14.768944 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:14.769528 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.769549 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.771689 (+ 2140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.771695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.774461 (+ 2766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.774477 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.776438 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.776445 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.776737 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.776780 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.776966 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.777196 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13014,"mutex_wait_us":68,"thread_start_us":15808,"threads_started":1}
I20260808 08:41:14.778836 31971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.754156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:40395 (local address 127.0.0.1:58304)
0808 08:41:14.769918 (+ 15762us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:14.769945 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:14.770108 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:14.770891 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:14.770896 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:14.770923 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:14.771430 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.771445 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.773257 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.773264 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.775665 (+ 2401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.775679 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.777964 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.777970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.778150 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.778184 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.778288 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.778434 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15581,"mutex_wait_us":1,"thread_start_us":12688,"threads_started":1}
I20260808 08:41:14.778910 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.754906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58304 (local address 127.19.242.195:40395)
0808 08:41:14.766323 (+ 11417us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.766335 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.770175 (+ 3840us) server_negotiation.cc:407] Connection header received
0808 08:41:14.770312 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.770320 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.770603 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.770832 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:14.771703 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.773097 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.775889 (+ 2792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.777396 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.777598 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.777815 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.778360 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.778532 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11152,"thread_start_us":11434,"threads_started":1}
I20260808 08:41:14.781061 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.754783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:42919 (local address 127.0.0.1:59694)
0808 08:41:14.771283 (+ 16500us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:14.771306 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:14.771549 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:14.772531 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:14.772536 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:14.772562 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:14.772971 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.772984 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.774962 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.774967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.777315 (+ 2348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.777333 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.780063 (+ 2730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.780072 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.780280 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.780316 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.780410 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.780547 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15212,"mutex_wait_us":89,"thread_start_us":14665,"threads_started":1}
I20260808 08:41:14.782196 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.755438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59694 (local address 127.19.242.193:42919)
0808 08:41:14.769244 (+ 13806us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.769252 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.771420 (+ 2168us) server_negotiation.cc:407] Connection header received
0808 08:41:14.771772 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.771781 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.772072 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.772243 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:14.773218 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.774814 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.777538 (+ 2724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.779668 (+ 2130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.779866 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.781557 (+ 1691us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.781636 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.781812 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13629,"thread_start_us":13455,"threads_started":1}
I20260808 08:41:14.782475 31836 tablet_service.cc:1467] Processing CreateTablet for tablet ad519b87299b4c8290fde25ca7988882 (DEFAULT_TABLE table=test-table [id=b47f53303d954501ada87cfc7530107d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:14.782464 31623 tablet_service.cc:1467] Processing CreateTablet for tablet ad519b87299b4c8290fde25ca7988882 (DEFAULT_TABLE table=test-table [id=b47f53303d954501ada87cfc7530107d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:14.783968 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad519b87299b4c8290fde25ca7988882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:14.784093 31836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad519b87299b4c8290fde25ca7988882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:14.786270 31418 tablet_service.cc:1467] Processing CreateTablet for tablet ad519b87299b4c8290fde25ca7988882 (DEFAULT_TABLE table=test-table [id=b47f53303d954501ada87cfc7530107d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:14.787873 31418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad519b87299b4c8290fde25ca7988882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:14.796907 31974 tablet_bootstrap.cc:492] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Bootstrap starting.
I20260808 08:41:14.801237 31974 tablet_bootstrap.cc:654] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:14.801534 31975 tablet_bootstrap.cc:492] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Bootstrap starting.
I20260808 08:41:14.802963 31974 log.cc:824] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:14.804170 31977 tablet_bootstrap.cc:492] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Bootstrap starting.
I20260808 08:41:14.806104 31975 tablet_bootstrap.cc:654] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:14.807323 31977 tablet_bootstrap.cc:654] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:14.807871 31975 log.cc:824] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:14.808650 31977 log.cc:824] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:14.812842 31977 tablet_bootstrap.cc:492] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: No bootstrap required, opened a new log
I20260808 08:41:14.813022 31974 tablet_bootstrap.cc:492] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: No bootstrap required, opened a new log
I20260808 08:41:14.813022 31975 tablet_bootstrap.cc:492] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: No bootstrap required, opened a new log
I20260808 08:41:14.813208 31977 ts_tablet_manager.cc:1397] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 08:41:14.813329 31975 ts_tablet_manager.cc:1397] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260808 08:41:14.813329 31974 ts_tablet_manager.cc:1397] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.009s
I20260808 08:41:14.822090 31977 raft_consensus.cc:348] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.822551 31977 raft_consensus.cc:374] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:14.822665 31977 raft_consensus.cc:729] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a57fcbbdfc4019959539782704eb34, State: Initialized, Role: FOLLOWER
I20260808 08:41:14.823407 31977 consensus_queue.cc:260] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.824961 31975 raft_consensus.cc:348] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.824961 31974 raft_consensus.cc:348] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.825439 31974 raft_consensus.cc:374] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:14.825439 31975 raft_consensus.cc:374] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:14.825551 31975 raft_consensus.cc:729] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Initialized, Role: FOLLOWER
I20260808 08:41:14.825560 31974 raft_consensus.cc:729] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0958d2ff9e4aeda5345caeb04019a6, State: Initialized, Role: FOLLOWER
I20260808 08:41:14.826220 31975 consensus_queue.cc:260] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.826217 31974 consensus_queue.cc:260] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.827375 31977 ts_tablet_manager.cc:1428] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260808 08:41:14.828989 31725 heartbeater.cc:503] Master 127.19.242.254:33165 was elected leader, sending a full tablet report...
I20260808 08:41:14.829041 31932 heartbeater.cc:503] Master 127.19.242.254:33165 was elected leader, sending a full tablet report...
I20260808 08:41:14.829308 31975 ts_tablet_manager.cc:1428] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent starting tablet: real 0.016s user 0.015s sys 0.002s
I20260808 08:41:14.830439 31974 ts_tablet_manager.cc:1428] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260808 08:41:14.847108 31985 raft_consensus.cc:482] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:14.847491 31985 raft_consensus.cc:504] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.849346 31985 leader_election.cc:288] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061), 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919)
I20260808 08:41:14.855876 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.849821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:48239 (local address 127.19.242.193:42919)
0808 08:41:14.850060 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.850069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.850490 (+ 421us) server_negotiation.cc:407] Connection header received
0808 08:41:14.850577 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.850581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.850682 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.850789 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:14.851450 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.852207 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.854049 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.854921 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.855111 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.855196 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.855472 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.855609 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:41:14.855904 31764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.849826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:42919 (local address 127.19.242.195:48239)
0808 08:41:14.850170 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:14.850191 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:14.850348 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:14.850988 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:14.850993 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:14.851022 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:14.851276 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.851287 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.852353 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.852360 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.853844 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.853857 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.855087 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.855093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.855292 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.855319 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.855431 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.855582 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260808 08:41:14.856523 31970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.849889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:48975 (local address 127.19.242.194:37061)
0808 08:41:14.850170 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.850178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.851271 (+ 1093us) server_negotiation.cc:407] Connection header received
0808 08:41:14.851483 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.851486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.851548 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.851649 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:14.852198 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.852913 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.854746 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.855532 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.855735 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.855814 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.856185 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.856321 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:41:14.857123 31987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.850356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:37061 (local address 127.19.242.195:48975)
0808 08:41:14.851137 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:14.851153 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:14.851326 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:14.851665 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:14.851669 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:14.851694 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:14.852029 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.852039 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.853061 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.853067 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.854546 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:14.854558 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.855781 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.855787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:14.855951 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.856009 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 08:41:14.856721 (+ 712us) client_negotiation.cc:240] Negotiation successful
0808 08:41:14.856873 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":441,"threads_started":1}
I20260808 08:41:14.857079 31447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad519b87299b4c8290fde25ca7988882" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34" is_pre_election: true
I20260808 08:41:14.857672 31447 raft_consensus.cc:2454] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:14.858357 31650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad519b87299b4c8290fde25ca7988882" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" is_pre_election: true
I20260808 08:41:14.858676 31756 leader_election.cc:302] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ef14d1d003c46ad93e1d6ebb082c325, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:14.859010 31650 raft_consensus.cc:2454] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:14.859272 31985 raft_consensus.cc:2781] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:14.859450 31985 raft_consensus.cc:482] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:14.859592 31985 raft_consensus.cc:3037] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:14.861959 31985 raft_consensus.cc:504] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.862671 31985 leader_election.cc:288] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Requested vote from peers 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061), 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919)
I20260808 08:41:14.863335 31650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad519b87299b4c8290fde25ca7988882" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
I20260808 08:41:14.863358 31447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad519b87299b4c8290fde25ca7988882" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34"
I20260808 08:41:14.863569 31650 raft_consensus.cc:3037] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:14.863583 31447 raft_consensus.cc:3037] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:14.865934 31447 raft_consensus.cc:2454] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:14.865942 31650 raft_consensus.cc:2454] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:14.866499 31756 leader_election.cc:302] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ef14d1d003c46ad93e1d6ebb082c325, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:14.866895 31985 raft_consensus.cc:2781] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:14.867424 31985 raft_consensus.cc:686] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Becoming Leader. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Running, Role: LEADER
I20260808 08:41:14.867928 31985 consensus_queue.cc:237] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } }
I20260808 08:41:14.872951 31201 catalog_manager.cc:5495] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } health_report { overall_health: UNKNOWN } } }
W20260808 08:41:14.877285 31934 tablet.cc:2369] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:41:14.908439 31528 tablet.cc:2369] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:41:14.910108 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:14.904030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58312 (local address 127.19.242.195:40395)
0808 08:41:14.904262 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:14.904271 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:14.904467 (+ 196us) server_negotiation.cc:407] Connection header received
0808 08:41:14.904675 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:14.904679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:14.904764 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:14.904904 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:14.905293 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.906038 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.907477 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:14.907945 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:14.908045 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:14.908756 (+ 711us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:14.909457 (+ 701us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:14.909574 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:14.909696 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 08:41:14.909785 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:41:14.919478 31650 raft_consensus.cc:1261] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:14.919453 31447 raft_consensus.cc:1261] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:14.920713 31985 consensus_queue.cc:1035] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:14.921247 31989 consensus_queue.cc:1035] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:14.936184 31996 mvcc.cc:205] Tried to move back new op lower bound from 7316187033258807296 to 7316187033063096320. Current Snapshot: MvccSnapshot[applied={T|T < 7316187033258807296}]
I20260808 08:41:14.948976 31199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:14.949375 31199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:14.954133 31199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Sending DeleteTablet for 3 replicas of tablet ad519b87299b4c8290fde25ca7988882
I20260808 08:41:14.955655 31623 tablet_service.cc:1514] Processing DeleteTablet for tablet ad519b87299b4c8290fde25ca7988882 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:14 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:41506
I20260808 08:41:14.955914 31418 tablet_service.cc:1514] Processing DeleteTablet for tablet ad519b87299b4c8290fde25ca7988882 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:14 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:59694
I20260808 08:41:14.956594 31836 tablet_service.cc:1514] Processing DeleteTablet for tablet ad519b87299b4c8290fde25ca7988882 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:14 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:58304
I20260808 08:41:14.957618 31199 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:41:14.958779 31199 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:14.960399 32010 tablet_replica.cc:330] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: stopping tablet replica
I20260808 08:41:14.961072 32010 raft_consensus.cc:2229] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:14.962898 32010 raft_consensus.cc:2258] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:14.966241 32010 ts_tablet_manager.cc:1905] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:14.968233 32013 tablet_replica.cc:330] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: stopping tablet replica
I20260808 08:41:14.968770 32013 raft_consensus.cc:2229] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:41:14.969580 32013 raft_consensus.cc:2258] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:14.971715 31417 tablet_service.cc:1467] Processing CreateTablet for tablet a28d805c67f54403a0238a3119470dea (DEFAULT_TABLE table=test-table [id=1a419040a0be4f01ad3a9dd0d41f9122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:14.972391 31417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a28d805c67f54403a0238a3119470dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:14.972292 31623 tablet_service.cc:1467] Processing CreateTablet for tablet a28d805c67f54403a0238a3119470dea (DEFAULT_TABLE table=test-table [id=1a419040a0be4f01ad3a9dd0d41f9122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:14.972785 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a28d805c67f54403a0238a3119470dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:14.976094 32010 ts_tablet_manager.cc:1918] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:14.976434 32010 log.cc:1196] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/ad519b87299b4c8290fde25ca7988882
I20260808 08:41:14.977258 32010 ts_tablet_manager.cc:1939] T ad519b87299b4c8290fde25ca7988882 P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting consensus metadata
I20260808 08:41:14.979393 31834 tablet_service.cc:1467] Processing CreateTablet for tablet a28d805c67f54403a0238a3119470dea (DEFAULT_TABLE table=test-table [id=1a419040a0be4f01ad3a9dd0d41f9122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:14.980147 31834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a28d805c67f54403a0238a3119470dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:14.980141 31181 catalog_manager.cc:4841] TS 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061): tablet ad519b87299b4c8290fde25ca7988882 (table test-table [id=b47f53303d954501ada87cfc7530107d]) successfully deleted
I20260808 08:41:14.980520 31974 tablet_bootstrap.cc:492] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Bootstrap starting.
I20260808 08:41:14.981436 32011 tablet_replica.cc:330] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: stopping tablet replica
I20260808 08:41:14.981945 32011 raft_consensus.cc:2229] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:14.982488 32011 raft_consensus.cc:2258] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:14.982620 31974 tablet_bootstrap.cc:654] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:14.983829 31977 tablet_bootstrap.cc:492] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: Bootstrap starting.
I20260808 08:41:14.985572 31977 tablet_bootstrap.cc:654] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:14.985610 31974 tablet_bootstrap.cc:492] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: No bootstrap required, opened a new log
I20260808 08:41:14.985780 31974 ts_tablet_manager.cc:1397] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:41:14.986876 31974 raft_consensus.cc:348] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:14.987114 31974 raft_consensus.cc:374] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:14.987218 31974 raft_consensus.cc:729] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0958d2ff9e4aeda5345caeb04019a6, State: Initialized, Role: FOLLOWER
I20260808 08:41:14.987567 31974 consensus_queue.cc:260] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:14.988082 31975 tablet_bootstrap.cc:492] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: Bootstrap starting.
I20260808 08:41:14.990042 31975 tablet_bootstrap.cc:654] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:14.990270 32011 ts_tablet_manager.cc:1905] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:14.991331 31974 ts_tablet_manager.cc:1428] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:41:14.994067 32013 ts_tablet_manager.cc:1905] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:14.995596 31977 tablet_bootstrap.cc:492] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: No bootstrap required, opened a new log
I20260808 08:41:14.995774 31977 ts_tablet_manager.cc:1397] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.003s
I20260808 08:41:14.997316 31977 raft_consensus.cc:348] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:14.997572 31977 raft_consensus.cc:374] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:14.997660 31977 raft_consensus.cc:729] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a57fcbbdfc4019959539782704eb34, State: Initialized, Role: FOLLOWER
I20260808 08:41:14.997953 31977 consensus_queue.cc:260] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:14.998739 31977 ts_tablet_manager.cc:1428] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:15.002434 32013 ts_tablet_manager.cc:1918] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:15.002687 32013 log.cc:1196] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/ad519b87299b4c8290fde25ca7988882
I20260808 08:41:15.003351 32013 ts_tablet_manager.cc:1939] T ad519b87299b4c8290fde25ca7988882 P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting consensus metadata
I20260808 08:41:15.004379 32011 ts_tablet_manager.cc:1918] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:15.004575 32011 log.cc:1196] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/ad519b87299b4c8290fde25ca7988882
I20260808 08:41:15.005330 32011 ts_tablet_manager.cc:1939] T ad519b87299b4c8290fde25ca7988882 P 30a57fcbbdfc4019959539782704eb34: Deleting consensus metadata
I20260808 08:41:15.005725 31182 catalog_manager.cc:4841] TS 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195:40395): tablet ad519b87299b4c8290fde25ca7988882 (table test-table [id=b47f53303d954501ada87cfc7530107d]) successfully deleted
I20260808 08:41:15.007318 31183 catalog_manager.cc:4841] TS 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919): tablet ad519b87299b4c8290fde25ca7988882 (table test-table [id=b47f53303d954501ada87cfc7530107d]) successfully deleted
I20260808 08:41:15.008008 31975 tablet_bootstrap.cc:492] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: No bootstrap required, opened a new log
I20260808 08:41:15.008220 31975 ts_tablet_manager.cc:1397] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.004s
I20260808 08:41:15.009232 31975 raft_consensus.cc:348] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.009514 31975 raft_consensus.cc:374] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:15.009641 31975 raft_consensus.cc:729] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Initialized, Role: FOLLOWER
I20260808 08:41:15.010017 31975 consensus_queue.cc:260] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.010738 31975 ts_tablet_manager.cc:1428] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260808 08:41:15.025039 31726 tablet.cc:2369] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:41:15.095033 32001 raft_consensus.cc:482] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:15.095305 32001 raft_consensus.cc:504] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.096228 32001 leader_election.cc:288] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919), 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061)
I20260808 08:41:15.096793 31447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28d805c67f54403a0238a3119470dea" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34" is_pre_election: true
I20260808 08:41:15.097112 31447 raft_consensus.cc:2454] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:15.097676 31756 leader_election.cc:302] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ef14d1d003c46ad93e1d6ebb082c325, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:15.097621 31650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28d805c67f54403a0238a3119470dea" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" is_pre_election: true
I20260808 08:41:15.097906 31650 raft_consensus.cc:2454] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:15.098029 32001 raft_consensus.cc:2781] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:15.098168 32001 raft_consensus.cc:482] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:15.098307 32001 raft_consensus.cc:3037] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:15.100889 32001 raft_consensus.cc:504] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.101622 32001 leader_election.cc:288] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Requested vote from peers 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919), 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061)
I20260808 08:41:15.102372 31447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28d805c67f54403a0238a3119470dea" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34"
I20260808 08:41:15.102628 31447 raft_consensus.cc:3037] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:15.102530 31650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a28d805c67f54403a0238a3119470dea" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
I20260808 08:41:15.102862 31650 raft_consensus.cc:3037] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:15.105417 31650 raft_consensus.cc:2454] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:15.106055 31753 leader_election.cc:302] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0958d2ff9e4aeda5345caeb04019a6, 2ef14d1d003c46ad93e1d6ebb082c325; no voters:
I20260808 08:41:15.106110 31447 raft_consensus.cc:2454] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:15.106503 32001 raft_consensus.cc:2781] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:15.106688 32001 raft_consensus.cc:686] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Becoming Leader. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Running, Role: LEADER
I20260808 08:41:15.107072 32001 consensus_queue.cc:237] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.110543 31199 catalog_manager.cc:5495] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } health_report { overall_health: HEALTHY } } }
Aug 08 08:41:15 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178472, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.254@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:15.163640 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.145650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:33165 (local address 127.0.0.1:54118)
0808 08:41:15.146398 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:15.146419 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:15.146590 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:15.147033 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:15.147039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:15.148024 (+ 985us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:15.148414 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.148428 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.149501 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.149506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.151118 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.151136 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.151939 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.151946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.152141 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.153009 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:15.153036 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:15.156146 (+ 3110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:15.160259 (+ 4113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:15.160275 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:15.160282 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:15.160781 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:15.161328 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:15.161336 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:15.161341 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:15.161485 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:15.162435 (+ 950us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:15.162443 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:15.162644 (+ 201us) client_negotiation.cc:769] Sending connection context
0808 08:41:15.162958 (+ 314us) client_negotiation.cc:240] Negotiation successful
0808 08:41:15.163253 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":418,"threads_started":1}
I20260808 08:41:15.163890 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.145612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54118 (local address 127.19.242.254:33165)
0808 08:41:15.145900 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.145909 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.146548 (+ 639us) server_negotiation.cc:407] Connection header received
0808 08:41:15.146772 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.146783 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.146852 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.146953 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:15.148597 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.149349 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.151319 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.151732 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.151846 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.156440 (+ 4594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:15.156448 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:15.156454 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:15.156501 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:15.160062 (+ 3561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:15.160921 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:15.160929 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:15.160933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:15.161082 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:15.161602 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:15.161607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:15.161611 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:15.161994 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:15.162162 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:15.163112 (+ 950us) server_negotiation.cc:299] Negotiation successful
0808 08:41:15.163459 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":135}
I20260808 08:41:15.170305 31199 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:54118:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:41:15.171682 31199 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:15.179914 31418 tablet_service.cc:1467] Processing CreateTablet for tablet db808e1dc1484f7c84fd78397cce57f1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a973118ef5fb4edbb404a02f7fab0527]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:41:15.180725 31418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db808e1dc1484f7c84fd78397cce57f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:15.180594 31623 tablet_service.cc:1467] Processing CreateTablet for tablet db808e1dc1484f7c84fd78397cce57f1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a973118ef5fb4edbb404a02f7fab0527]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:41:15.181197 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db808e1dc1484f7c84fd78397cce57f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:15.185617 31834 tablet_service.cc:1467] Processing CreateTablet for tablet db808e1dc1484f7c84fd78397cce57f1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a973118ef5fb4edbb404a02f7fab0527]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:41:15.186327 31834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet db808e1dc1484f7c84fd78397cce57f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:15.191485 31977 tablet_bootstrap.cc:492] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: Bootstrap starting.
I20260808 08:41:15.191485 31974 tablet_bootstrap.cc:492] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: Bootstrap starting.
I20260808 08:41:15.193606 31977 tablet_bootstrap.cc:654] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:15.193606 31974 tablet_bootstrap.cc:654] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:15.195123 31975 tablet_bootstrap.cc:492] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: Bootstrap starting.
I20260808 08:41:15.199324 31975 tablet_bootstrap.cc:654] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:15.204697 31974 tablet_bootstrap.cc:492] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: No bootstrap required, opened a new log
I20260808 08:41:15.204932 31974 ts_tablet_manager.cc:1397] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.002s
I20260808 08:41:15.205565 31977 tablet_bootstrap.cc:492] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: No bootstrap required, opened a new log
I20260808 08:41:15.205821 31977 ts_tablet_manager.cc:1397] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260808 08:41:15.205869 31974 raft_consensus.cc:348] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.206180 31974 raft_consensus.cc:374] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:15.206274 31974 raft_consensus.cc:729] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0958d2ff9e4aeda5345caeb04019a6, State: Initialized, Role: FOLLOWER
I20260808 08:41:15.206403 31975 tablet_bootstrap.cc:492] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: No bootstrap required, opened a new log
I20260808 08:41:15.206616 31975 ts_tablet_manager.cc:1397] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260808 08:41:15.206542 31974 consensus_queue.cc:260] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.207171 31977 raft_consensus.cc:348] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.207188 31984 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.207563 31984 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:41:15.207616 31977 raft_consensus.cc:374] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:15.207528 31975 raft_consensus.cc:348] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.207875 31975 raft_consensus.cc:374] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:15.207885 31977 raft_consensus.cc:729] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a57fcbbdfc4019959539782704eb34, State: Initialized, Role: FOLLOWER
I20260808 08:41:15.207988 31975 raft_consensus.cc:729] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Initialized, Role: FOLLOWER
I20260808 08:41:15.208365 31975 consensus_queue.cc:260] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.209089 32001 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.209493 32001 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:41:15.209839 31977 consensus_queue.cc:260] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.211004 31975 ts_tablet_manager.cc:1428] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260808 08:41:15.210813 31983 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.211431 31983 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:41:15.211808 31977 ts_tablet_manager.cc:1428] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260808 08:41:15.212478 31974 ts_tablet_manager.cc:1428] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260808 08:41:15.315584 31983 raft_consensus.cc:482] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:15.315827 31983 raft_consensus.cc:504] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.317560 31983 leader_election.cc:288] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061), 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195:40395)
I20260808 08:41:15.328474 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.318512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:56351 (local address 127.19.242.195:40395)
0808 08:41:15.318776 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.318783 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.320179 (+ 1396us) server_negotiation.cc:407] Connection header received
0808 08:41:15.320514 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.320520 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.320652 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.320769 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:15.322413 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.323626 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.326237 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.327260 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.327496 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.327594 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:15.327945 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 08:41:15.328103 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:41:15.328506 32030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.318038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:40395 (local address 127.19.242.193:56351)
0808 08:41:15.320025 (+ 1987us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:15.320066 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:15.320313 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:15.321581 (+ 1268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:15.321587 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:15.321621 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:15.322168 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.322185 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.323845 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.323851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.326005 (+ 2154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.326019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.327529 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.327536 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.327719 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.327760 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:41:15.327894 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 08:41:15.328072 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1598,"spinlock_wait_cycles":4864,"thread_start_us":997,"threads_started":1}
I20260808 08:41:15.328825 31970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.318340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:36503 (local address 127.19.242.194:37061)
0808 08:41:15.318573 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.318581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.319614 (+ 1033us) server_negotiation.cc:407] Connection header received
0808 08:41:15.320583 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.320590 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.320682 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.320766 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:15.321993 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.323033 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.325947 (+ 2914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.327328 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.327543 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.327626 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:15.328291 (+ 665us) server_negotiation.cc:299] Negotiation successful
0808 08:41:15.328479 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:41:15.329600 31865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db808e1dc1484f7c84fd78397cce57f1" candidate_uuid: "30a57fcbbdfc4019959539782704eb34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" is_pre_election: true
I20260808 08:41:15.329902 32031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.318008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:37061 (local address 127.19.242.193:36503)
0808 08:41:15.319396 (+ 1388us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:15.319423 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:15.320072 (+ 649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:15.320989 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:15.320994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:15.321103 (+ 109us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:15.321546 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.321708 (+ 162us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.323194 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.323200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.325664 (+ 2464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.325693 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.327834 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.327842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.328043 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.328080 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:41:15.329262 (+ 1182us) client_negotiation.cc:240] Negotiation successful
0808 08:41:15.329454 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1217,"thread_start_us":1458,"threads_started":1}
I20260808 08:41:15.330155 31865 raft_consensus.cc:2454] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a57fcbbdfc4019959539782704eb34 in term 0.
I20260808 08:41:15.330765 31650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db808e1dc1484f7c84fd78397cce57f1" candidate_uuid: "30a57fcbbdfc4019959539782704eb34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" is_pre_election: true
I20260808 08:41:15.331089 31650 raft_consensus.cc:2454] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30a57fcbbdfc4019959539782704eb34 in term 0.
I20260808 08:41:15.330991 31341 leader_election.cc:302] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ef14d1d003c46ad93e1d6ebb082c325, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:15.331487 31983 raft_consensus.cc:2781] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:15.331634 31983 raft_consensus.cc:482] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:15.331749 31983 raft_consensus.cc:3037] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:15.334091 31983 raft_consensus.cc:504] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.334967 31983 leader_election.cc:288] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [CANDIDATE]: Term 1 election: Requested vote from peers 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061), 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195:40395)
I20260808 08:41:15.335577 31650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db808e1dc1484f7c84fd78397cce57f1" candidate_uuid: "30a57fcbbdfc4019959539782704eb34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
I20260808 08:41:15.335716 31865 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db808e1dc1484f7c84fd78397cce57f1" candidate_uuid: "30a57fcbbdfc4019959539782704eb34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ef14d1d003c46ad93e1d6ebb082c325"
I20260808 08:41:15.335903 31650 raft_consensus.cc:3037] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:15.335965 31865 raft_consensus.cc:3037] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:15.339618 31650 raft_consensus.cc:2454] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a57fcbbdfc4019959539782704eb34 in term 1.
I20260808 08:41:15.339800 31865 raft_consensus.cc:2454] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30a57fcbbdfc4019959539782704eb34 in term 1.
I20260808 08:41:15.340302 31340 leader_election.cc:302] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0958d2ff9e4aeda5345caeb04019a6, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:15.340793 31983 raft_consensus.cc:2781] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:15.341364 31983 raft_consensus.cc:686] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [term 1 LEADER]: Becoming Leader. State: Replica: 30a57fcbbdfc4019959539782704eb34, State: Running, Role: LEADER
I20260808 08:41:15.341835 31983 consensus_queue.cc:237] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.344285 32034 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: TxnStatusTablet state changed. Reason: New leader 30a57fcbbdfc4019959539782704eb34. Latest consensus state: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.344762 32034 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:41:15.345744 32036 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:41:15.346002 32036 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:41:15.346438 31199 catalog_manager.cc:5495] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30a57fcbbdfc4019959539782704eb34 (127.19.242.193). New cstate: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } health_report { overall_health: UNKNOWN } } }
I20260808 08:41:15.375595 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.361908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:42919 (local address 127.0.0.1:59702)
0808 08:41:15.362325 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:15.362349 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:15.362527 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:15.368023 (+ 5496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:15.368031 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:15.368050 (+ 19us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:41:15.368299 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.368313 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.369999 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.370008 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.371825 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.371850 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.373098 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.373106 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.373344 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.373446 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:41:15.374894 (+ 1448us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:41:15.374928 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:41:15.375048 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 08:41:15.375245 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260808 08:41:15.375605 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.362004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59702 (local address 127.19.242.193:42919)
0808 08:41:15.367353 (+ 5349us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.367361 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.367393 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:41:15.367532 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.367539 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.367674 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.367935 (+ 261us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:15.368532 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.369808 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.372075 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.372821 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.373042 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.373715 (+ 673us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:15.374663 (+ 948us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:15.374925 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:15.375098 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 08:41:15.375218 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5164,"thread_start_us":4922,"threads_started":1}
I20260808 08:41:15.381307 31650 raft_consensus.cc:1261] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Refusing update from remote peer 30a57fcbbdfc4019959539782704eb34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:15.381354 31865 raft_consensus.cc:1261] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Refusing update from remote peer 30a57fcbbdfc4019959539782704eb34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:15.382323 31983 consensus_queue.cc:1035] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:15.383152 31983 consensus_queue.cc:1035] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:15.396402 32001 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: TxnStatusTablet state changed. Reason: New leader 30a57fcbbdfc4019959539782704eb34. Latest consensus state: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.396814 32001 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:41:15.397719 31984 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: TxnStatusTablet state changed. Reason: New leader 30a57fcbbdfc4019959539782704eb34. Latest consensus state: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.398047 31984 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:41:15.399004 31983 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.401889 31983 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:41:15.403936 31995 mvcc.cc:205] Tried to move back new op lower bound from 7316187035151736832 to 7316187035005239296. Current Snapshot: MvccSnapshot[applied={T|T < 7316187035151736832}]
I20260808 08:41:15.404475 31984 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.404724 31984 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 2c0958d2ff9e4aeda5345caeb04019a6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:41:15.409363 32034 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.409657 32034 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 30a57fcbbdfc4019959539782704eb34: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:41:15.412703 32001 tablet_replica.cc:439] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30a57fcbbdfc4019959539782704eb34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } } }
I20260808 08:41:15.413051 32001 tablet_replica.cc:442] T db808e1dc1484f7c84fd78397cce57f1 P 2ef14d1d003c46ad93e1d6ebb082c325: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:41:15.455030 32039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.445238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:46255 (local address 127.19.242.193:42919)
0808 08:41:15.445477 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.445485 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.447603 (+ 2118us) server_negotiation.cc:407] Connection header received
0808 08:41:15.447861 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.447868 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.447963 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.448090 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:15.448757 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.449965 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.452514 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.453213 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.453355 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.454060 (+ 705us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:15.454227 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:15.454336 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:15.454544 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 08:41:15.454642 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:41:15.455386 32045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.445189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:42919 (local address 127.19.242.195:46255)
0808 08:41:15.447437 (+ 2248us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:15.447462 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:15.447669 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:15.448125 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:15.448131 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:15.448147 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:41:15.448545 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.448561 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.450142 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.450151 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.452315 (+ 2164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.452337 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.453452 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.453463 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.453705 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.453803 (+ 98us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:41:15.454361 (+ 558us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:41:15.454377 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 08:41:15.454499 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:41:15.454688 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1968,"thread_start_us":1740,"threads_started":1}
I20260808 08:41:15.470553 31650 raft_consensus.cc:1261] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:15.471386 31989 consensus_queue.cc:1035] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:15.472566 31447 raft_consensus.cc:1261] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:15.473173 31989 consensus_queue.cc:1035] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:15.488524 31993 mvcc.cc:205] Tried to move back new op lower bound from 7316187035519021056 to 7316187034041974784. Current Snapshot: MvccSnapshot[applied={T|T < 7316187035519021056}]
I20260808 08:41:15.540037 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.531333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:57983 (local address 127.19.242.195:40395)
0808 08:41:15.531599 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.531609 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.533223 (+ 1614us) server_negotiation.cc:407] Connection header received
0808 08:41:15.533463 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.533469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.533563 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.533669 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:15.534562 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.535674 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.537862 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.538324 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.538482 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.539139 (+ 657us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:15.539303 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:15.539374 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:15.539642 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 08:41:15.539745 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:41:15.541438 32050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.530750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:40395 (local address 127.19.242.193:57983)
0808 08:41:15.533075 (+ 2325us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:15.533094 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:15.533302 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:15.533868 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:15.533871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:15.533882 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:41:15.534296 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.534311 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.535963 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.535973 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.537675 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:15.537694 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.538566 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.538573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:15.538794 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.538900 (+ 106us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:41:15.539479 (+ 579us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:41:15.539491 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:41:15.540347 (+ 856us) client_negotiation.cc:240] Negotiation successful
0808 08:41:15.540518 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2072,"thread_start_us":1871,"threads_started":1}
I20260808 08:41:15.588410 31201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:15.588689 31201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:15.592257 31201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Sending DeleteTablet for 3 replicas of tablet a28d805c67f54403a0238a3119470dea
I20260808 08:41:15.593303 31418 tablet_service.cc:1514] Processing DeleteTablet for tablet a28d805c67f54403a0238a3119470dea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:15 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:59694
I20260808 08:41:15.593398 31623 tablet_service.cc:1514] Processing DeleteTablet for tablet a28d805c67f54403a0238a3119470dea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:15 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:41506
I20260808 08:41:15.594007 31834 tablet_service.cc:1514] Processing DeleteTablet for tablet a28d805c67f54403a0238a3119470dea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:15 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:58304
I20260808 08:41:15.606197 32054 tablet_replica.cc:330] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: stopping tablet replica
I20260808 08:41:15.606557 32054 raft_consensus.cc:2229] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:15.606933 32054 raft_consensus.cc:2258] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:15.608342 32054 ts_tablet_manager.cc:1905] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:15.616969 32054 ts_tablet_manager.cc:1918] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:41:15.617281 32054 log.cc:1196] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/a28d805c67f54403a0238a3119470dea
I20260808 08:41:15.617908 32054 ts_tablet_manager.cc:1939] T a28d805c67f54403a0238a3119470dea P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting consensus metadata
I20260808 08:41:15.619484 31181 catalog_manager.cc:4841] TS 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061): tablet a28d805c67f54403a0238a3119470dea (table test-table [id=1a419040a0be4f01ad3a9dd0d41f9122]) successfully deleted
I20260808 08:41:15.619642 32057 tablet_replica.cc:330] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: stopping tablet replica
I20260808 08:41:15.619956 32057 raft_consensus.cc:2229] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:41:15.620541 32057 raft_consensus.cc:2258] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:15.621986 32057 ts_tablet_manager.cc:1905] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:15.623442 32056 tablet_replica.cc:330] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: stopping tablet replica
I20260808 08:41:15.623744 32056 raft_consensus.cc:2229] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:15.624204 32056 raft_consensus.cc:2258] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:15.629992 32056 ts_tablet_manager.cc:1905] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:15.630934 32057 ts_tablet_manager.cc:1918] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:41:15.631124 32057 log.cc:1196] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/a28d805c67f54403a0238a3119470dea
I20260808 08:41:15.631654 32057 ts_tablet_manager.cc:1939] T a28d805c67f54403a0238a3119470dea P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting consensus metadata
I20260808 08:41:15.632890 31182 catalog_manager.cc:4841] TS 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195:40395): tablet a28d805c67f54403a0238a3119470dea (table test-table [id=1a419040a0be4f01ad3a9dd0d41f9122]) successfully deleted
I20260808 08:41:15.639256 32056 ts_tablet_manager.cc:1918] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:41:15.639437 32056 log.cc:1196] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/a28d805c67f54403a0238a3119470dea
I20260808 08:41:15.639976 32056 ts_tablet_manager.cc:1939] T a28d805c67f54403a0238a3119470dea P 30a57fcbbdfc4019959539782704eb34: Deleting consensus metadata
I20260808 08:41:15.641326 31183 catalog_manager.cc:4841] TS 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919): tablet a28d805c67f54403a0238a3119470dea (table test-table [id=1a419040a0be4f01ad3a9dd0d41f9122]) successfully deleted
Aug 08 08:41:15 dist-test-slave-39l8 krb5kdc[31139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:41:15 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:15 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:41:15.721913 32065 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:15.707068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54132 (local address 127.19.242.254:33165)
0808 08:41:15.708591 (+ 1523us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.708596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.710096 (+ 1500us) server_negotiation.cc:407] Connection header received
0808 08:41:15.710423 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.710431 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.710519 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.710650 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:15.712350 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.713120 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.714475 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.715024 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.715264 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.721579 (+ 6315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54132: BlockingRecv error: recv got EOF from 127.0.0.1:54132 (error 108)
Metrics: {"server-negotiator.queue_time_us":1403,"thread_start_us":1248,"threads_started":1}
Aug 08 08:41:15 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM
I20260808 08:41:15.748968 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:15.730536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54146 (local address 127.19.242.254:33165)
0808 08:41:15.730794 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:15.730801 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:15.731117 (+ 316us) server_negotiation.cc:407] Connection header received
0808 08:41:15.731263 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:15.731269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:15.731372 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:15.731496 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:15.732902 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.734082 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.735665 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:15.736388 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:15.736544 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:15.741351 (+ 4807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:15.741361 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:15.741366 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:15.741426 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:15.745349 (+ 3923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:15.746382 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:15.746389 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:15.746394 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:15.746601 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:15.747234 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:15.747240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:15.747243 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:15.747652 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:15.747953 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:15.748317 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 08:41:15.748597 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:41:15.753486 31201 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:41:15.754292 31201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:15.763170 31418 tablet_service.cc:1467] Processing CreateTablet for tablet 7c903aca01dd4bf18e4547d3c99be4ae (DEFAULT_TABLE table=test-table [id=ef9a83167eab4966a1218f2e832eafb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:15.763465 31623 tablet_service.cc:1467] Processing CreateTablet for tablet 7c903aca01dd4bf18e4547d3c99be4ae (DEFAULT_TABLE table=test-table [id=ef9a83167eab4966a1218f2e832eafb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:15.763813 31418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c903aca01dd4bf18e4547d3c99be4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:15.763964 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c903aca01dd4bf18e4547d3c99be4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:15.770084 32075 tablet_bootstrap.cc:492] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: Bootstrap starting.
I20260808 08:41:15.770190 31834 tablet_service.cc:1467] Processing CreateTablet for tablet 7c903aca01dd4bf18e4547d3c99be4ae (DEFAULT_TABLE table=test-table [id=ef9a83167eab4966a1218f2e832eafb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:15.770768 31834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c903aca01dd4bf18e4547d3c99be4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:15.772636 32075 tablet_bootstrap.cc:654] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:15.782805 32078 tablet_bootstrap.cc:492] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: Bootstrap starting.
I20260808 08:41:15.783169 32075 tablet_bootstrap.cc:492] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: No bootstrap required, opened a new log
I20260808 08:41:15.783413 32075 ts_tablet_manager.cc:1397] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.001s
I20260808 08:41:15.785003 32078 tablet_bootstrap.cc:654] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:15.784899 32075 raft_consensus.cc:348] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.785270 32075 raft_consensus.cc:374] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:15.786285 32076 tablet_bootstrap.cc:492] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: Bootstrap starting.
I20260808 08:41:15.787640 32075 raft_consensus.cc:729] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a57fcbbdfc4019959539782704eb34, State: Initialized, Role: FOLLOWER
I20260808 08:41:15.788086 32075 consensus_queue.cc:260] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.788846 32076 tablet_bootstrap.cc:654] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:15.789902 32075 ts_tablet_manager.cc:1428] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260808 08:41:15.796213 32078 tablet_bootstrap.cc:492] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: No bootstrap required, opened a new log
I20260808 08:41:15.796438 32078 ts_tablet_manager.cc:1397] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.005s
I20260808 08:41:15.797490 32078 raft_consensus.cc:348] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.797814 32078 raft_consensus.cc:374] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:15.797932 32078 raft_consensus.cc:729] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Initialized, Role: FOLLOWER
I20260808 08:41:15.798282 32078 consensus_queue.cc:260] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.799204 32078 ts_tablet_manager.cc:1428] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20260808 08:41:15.799846 32076 tablet_bootstrap.cc:492] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: No bootstrap required, opened a new log
I20260808 08:41:15.800064 32076 ts_tablet_manager.cc:1397] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260808 08:41:15.801005 32076 raft_consensus.cc:348] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.801292 32076 raft_consensus.cc:374] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:15.801394 32076 raft_consensus.cc:729] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0958d2ff9e4aeda5345caeb04019a6, State: Initialized, Role: FOLLOWER
I20260808 08:41:15.801689 32076 consensus_queue.cc:260] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:15.802318 32076 ts_tablet_manager.cc:1428] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260808 08:41:16.067201 31989 raft_consensus.cc:482] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:16.067430 31989 raft_consensus.cc:504] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.068084 31989 leader_election.cc:288] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919), 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061)
I20260808 08:41:16.068769 31447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c903aca01dd4bf18e4547d3c99be4ae" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34" is_pre_election: true
I20260808 08:41:16.068791 31649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c903aca01dd4bf18e4547d3c99be4ae" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" is_pre_election: true
I20260808 08:41:16.069042 31447 raft_consensus.cc:2454] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:16.069056 31649 raft_consensus.cc:2454] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:16.069600 31756 leader_election.cc:302] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ef14d1d003c46ad93e1d6ebb082c325, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:16.069931 31989 raft_consensus.cc:2781] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:16.070034 31989 raft_consensus.cc:482] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:16.070119 31989 raft_consensus.cc:3037] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:16.072501 31989 raft_consensus.cc:504] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.073329 31989 leader_election.cc:288] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Requested vote from peers 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919), 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061)
I20260808 08:41:16.073917 31447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c903aca01dd4bf18e4547d3c99be4ae" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34"
I20260808 08:41:16.074007 31649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c903aca01dd4bf18e4547d3c99be4ae" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
I20260808 08:41:16.074187 31447 raft_consensus.cc:3037] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:16.074278 31649 raft_consensus.cc:3037] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:16.076434 31447 raft_consensus.cc:2454] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:16.076480 31649 raft_consensus.cc:2454] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:16.077098 31753 leader_election.cc:302] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2c0958d2ff9e4aeda5345caeb04019a6, 2ef14d1d003c46ad93e1d6ebb082c325, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:16.077466 31989 raft_consensus.cc:2781] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:16.077914 31989 raft_consensus.cc:686] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Becoming Leader. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Running, Role: LEADER
I20260808 08:41:16.078282 31989 consensus_queue.cc:237] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.081604 31201 catalog_manager.cc:5495] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } health_report { overall_health: HEALTHY } } }
I20260808 08:41:16.166499 32088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:16.160654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58320 (local address 127.19.242.195:40395)
0808 08:41:16.161259 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:16.161265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:16.161284 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:41:16.161352 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:16.161357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:16.161428 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:16.161524 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:16.162249 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.163113 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.164545 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.165021 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.165180 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:16.165684 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:16.165807 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:16.165916 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:16.166096 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 08:41:16.166195 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":330,"threads_started":1}
I20260808 08:41:16.170235 31447 raft_consensus.cc:1261] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:16.170229 31649 raft_consensus.cc:1261] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:16.171226 32082 consensus_queue.cc:1035] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:16.171633 31989 consensus_queue.cc:1035] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:16.192682 31201 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:16.193095 31201 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:16.196519 31201 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Sending DeleteTablet for 3 replicas of tablet 7c903aca01dd4bf18e4547d3c99be4ae
I20260808 08:41:16.197700 31623 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c903aca01dd4bf18e4547d3c99be4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:16 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:41506
I20260808 08:41:16.197687 31834 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c903aca01dd4bf18e4547d3c99be4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:16 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:58304
I20260808 08:41:16.198298 31418 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c903aca01dd4bf18e4547d3c99be4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:16 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:59694
I20260808 08:41:16.199018 32103 tablet_replica.cc:330] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: stopping tablet replica
I20260808 08:41:16.199087 31201 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 08:41:16.199316 32103 raft_consensus.cc:2229] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Raft consensus shutting down.
W20260808 08:41:16.199800 31201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:16.199954 32103 raft_consensus.cc:2258] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:16.201452 32103 ts_tablet_manager.cc:1905] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:16.203189 32107 tablet_replica.cc:330] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: stopping tablet replica
I20260808 08:41:16.203428 32107 raft_consensus.cc:2229] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:16.203744 32107 raft_consensus.cc:2258] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:16.204458 32102 tablet_replica.cc:330] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: stopping tablet replica
I20260808 08:41:16.204684 32102 raft_consensus.cc:2229] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:16.204982 32102 raft_consensus.cc:2258] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:16.205360 32107 ts_tablet_manager.cc:1905] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:16.206445 32102 ts_tablet_manager.cc:1905] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:16.210098 31623 tablet_service.cc:1467] Processing CreateTablet for tablet 590c277324964cfb92a5873a1b16bbd5 (DEFAULT_TABLE table=test-table [id=ec8b9d9b33444a23a681fc9e9d247a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:16.210127 31834 tablet_service.cc:1467] Processing CreateTablet for tablet 590c277324964cfb92a5873a1b16bbd5 (DEFAULT_TABLE table=test-table [id=ec8b9d9b33444a23a681fc9e9d247a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:16.210722 31834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590c277324964cfb92a5873a1b16bbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:16.210937 31623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590c277324964cfb92a5873a1b16bbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:16.213085 32107 ts_tablet_manager.cc:1918] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:16.213264 32107 log.cc:1196] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/7c903aca01dd4bf18e4547d3c99be4ae
I20260808 08:41:16.213846 32107 ts_tablet_manager.cc:1939] T 7c903aca01dd4bf18e4547d3c99be4ae P 30a57fcbbdfc4019959539782704eb34: Deleting consensus metadata
I20260808 08:41:16.214959 32102 ts_tablet_manager.cc:1918] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:16.215118 32102 log.cc:1196] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/7c903aca01dd4bf18e4547d3c99be4ae
I20260808 08:41:16.215293 31183 catalog_manager.cc:4841] TS 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919): tablet 7c903aca01dd4bf18e4547d3c99be4ae (table test-table [id=ef9a83167eab4966a1218f2e832eafb6]) successfully deleted
I20260808 08:41:16.215260 31418 tablet_service.cc:1467] Processing CreateTablet for tablet 590c277324964cfb92a5873a1b16bbd5 (DEFAULT_TABLE table=test-table [id=ec8b9d9b33444a23a681fc9e9d247a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:16.215610 32102 ts_tablet_manager.cc:1939] T 7c903aca01dd4bf18e4547d3c99be4ae P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting consensus metadata
I20260808 08:41:16.215734 31418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590c277324964cfb92a5873a1b16bbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:16.218108 32076 tablet_bootstrap.cc:492] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: Bootstrap starting.
I20260808 08:41:16.219259 31181 catalog_manager.cc:4841] TS 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061): tablet 7c903aca01dd4bf18e4547d3c99be4ae (table test-table [id=ef9a83167eab4966a1218f2e832eafb6]) successfully deleted
I20260808 08:41:16.219977 32076 tablet_bootstrap.cc:654] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:16.221769 32078 tablet_bootstrap.cc:492] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: Bootstrap starting.
I20260808 08:41:16.223680 32078 tablet_bootstrap.cc:654] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:16.224056 32103 ts_tablet_manager.cc:1918] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:16.224213 32103 log.cc:1196] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/7c903aca01dd4bf18e4547d3c99be4ae
I20260808 08:41:16.224684 32075 tablet_bootstrap.cc:492] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: Bootstrap starting.
I20260808 08:41:16.224746 32103 ts_tablet_manager.cc:1939] T 7c903aca01dd4bf18e4547d3c99be4ae P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting consensus metadata
I20260808 08:41:16.225919 31182 catalog_manager.cc:4841] TS 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195:40395): tablet 7c903aca01dd4bf18e4547d3c99be4ae (table test-table [id=ef9a83167eab4966a1218f2e832eafb6]) successfully deleted
I20260808 08:41:16.226444 32076 tablet_bootstrap.cc:492] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: No bootstrap required, opened a new log
I20260808 08:41:16.226485 32075 tablet_bootstrap.cc:654] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:16.226691 32076 ts_tablet_manager.cc:1397] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260808 08:41:16.227576 32076 raft_consensus.cc:348] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.227867 32076 raft_consensus.cc:374] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:16.227950 32078 tablet_bootstrap.cc:492] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: No bootstrap required, opened a new log
I20260808 08:41:16.227965 32076 raft_consensus.cc:729] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0958d2ff9e4aeda5345caeb04019a6, State: Initialized, Role: FOLLOWER
I20260808 08:41:16.228145 32078 ts_tablet_manager.cc:1397] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260808 08:41:16.228235 32076 consensus_queue.cc:260] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.228770 32075 tablet_bootstrap.cc:492] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: No bootstrap required, opened a new log
I20260808 08:41:16.228883 32076 ts_tablet_manager.cc:1428] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:41:16.228981 32075 ts_tablet_manager.cc:1397] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260808 08:41:16.229564 32078 raft_consensus.cc:348] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.229698 32075 raft_consensus.cc:348] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.229892 32078 raft_consensus.cc:374] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:16.229971 32078 raft_consensus.cc:729] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Initialized, Role: FOLLOWER
I20260808 08:41:16.229997 32075 raft_consensus.cc:374] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:16.230177 32075 raft_consensus.cc:729] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30a57fcbbdfc4019959539782704eb34, State: Initialized, Role: FOLLOWER
I20260808 08:41:16.230242 32078 consensus_queue.cc:260] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.230527 32075 consensus_queue.cc:260] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.230942 32078 ts_tablet_manager.cc:1428] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:16.231174 32075 ts_tablet_manager.cc:1428] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 08:41:16.232522 32096 raft_consensus.cc:482] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:16.232750 32096 raft_consensus.cc:504] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.233659 32096 leader_election.cc:288] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919), 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061)
I20260808 08:41:16.234423 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c277324964cfb92a5873a1b16bbd5" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34" is_pre_election: true
I20260808 08:41:16.234544 31649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c277324964cfb92a5873a1b16bbd5" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" is_pre_election: true
I20260808 08:41:16.234804 31446 raft_consensus.cc:2454] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:16.234838 31649 raft_consensus.cc:2454] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 0.
I20260808 08:41:16.235387 31753 leader_election.cc:302] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0958d2ff9e4aeda5345caeb04019a6, 2ef14d1d003c46ad93e1d6ebb082c325; no voters:
I20260808 08:41:16.236428 32096 raft_consensus.cc:2781] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:16.236537 32096 raft_consensus.cc:482] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:16.236661 32096 raft_consensus.cc:3037] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:16.239578 32096 raft_consensus.cc:504] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.240217 32096 leader_election.cc:288] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Requested vote from peers 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919), 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061)
I20260808 08:41:16.240922 31649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c277324964cfb92a5873a1b16bbd5" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0958d2ff9e4aeda5345caeb04019a6"
I20260808 08:41:16.240926 31446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590c277324964cfb92a5873a1b16bbd5" candidate_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30a57fcbbdfc4019959539782704eb34"
I20260808 08:41:16.241181 31446 raft_consensus.cc:3037] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:16.241182 31649 raft_consensus.cc:3037] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:16.244458 31446 raft_consensus.cc:2454] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:16.244457 31649 raft_consensus.cc:2454] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef14d1d003c46ad93e1d6ebb082c325 in term 1.
I20260808 08:41:16.245112 31756 leader_election.cc:302] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2c0958d2ff9e4aeda5345caeb04019a6, 2ef14d1d003c46ad93e1d6ebb082c325, 30a57fcbbdfc4019959539782704eb34; no voters:
I20260808 08:41:16.245561 32096 raft_consensus.cc:2781] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:16.245774 32096 raft_consensus.cc:686] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Becoming Leader. State: Replica: 2ef14d1d003c46ad93e1d6ebb082c325, State: Running, Role: LEADER
I20260808 08:41:16.246133 32096 consensus_queue.cc:237] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } }
I20260808 08:41:16.249058 31199 catalog_manager.cc:5495] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ef14d1d003c46ad93e1d6ebb082c325" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 40395 } health_report { overall_health: HEALTHY } } }
I20260808 08:41:16.277592 31649 raft_consensus.cc:1261] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:16.277781 31446 raft_consensus.cc:1261] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Refusing update from remote peer 2ef14d1d003c46ad93e1d6ebb082c325: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:16.278474 32101 consensus_queue.cc:1035] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30a57fcbbdfc4019959539782704eb34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 42919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:16.278937 32096 consensus_queue.cc:1035] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0958d2ff9e4aeda5345caeb04019a6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:16.334172 31199 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:16.334415 31199 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:16.337700 31199 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e687689aca934fafa4dfc8542f2970f5: Sending DeleteTablet for 3 replicas of tablet 590c277324964cfb92a5873a1b16bbd5
I20260808 08:41:16.338788 31623 tablet_service.cc:1514] Processing DeleteTablet for tablet 590c277324964cfb92a5873a1b16bbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:16 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:41506
I20260808 08:41:16.339164 31834 tablet_service.cc:1514] Processing DeleteTablet for tablet 590c277324964cfb92a5873a1b16bbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:16 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:58304
I20260808 08:41:16.339493 32102 tablet_replica.cc:330] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: stopping tablet replica
I20260808 08:41:16.339519 31418 tablet_service.cc:1514] Processing DeleteTablet for tablet 590c277324964cfb92a5873a1b16bbd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:16 UTC) from {username='oryx', principal='oryx/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:59694
I20260808 08:41:16.339766 32102 raft_consensus.cc:2229] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:16.339851 32107 tablet_replica.cc:330] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: stopping tablet replica
I20260808 08:41:16.339996 32102 raft_consensus.cc:2258] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:16.340060 32103 tablet_replica.cc:330] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: stopping tablet replica
I20260808 08:41:16.340083 32107 raft_consensus.cc:2229] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:16.340276 32103 raft_consensus.cc:2229] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:41:16.340303 32107 raft_consensus.cc:2258] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:16.340653 32103 raft_consensus.cc:2258] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:16.340857 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 31311
I20260808 08:41:16.341166 32102 ts_tablet_manager.cc:1905] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:16.341933 32103 ts_tablet_manager.cc:1905] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:16.341962 32107 ts_tablet_manager.cc:1905] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:16.348384 32102 ts_tablet_manager.cc:1918] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:41:16.348598 32102 log.cc:1196] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/590c277324964cfb92a5873a1b16bbd5
I20260808 08:41:16.348919 32103 ts_tablet_manager.cc:1918] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:41:16.349047 32102 ts_tablet_manager.cc:1939] T 590c277324964cfb92a5873a1b16bbd5 P 2c0958d2ff9e4aeda5345caeb04019a6: Deleting consensus metadata
I20260808 08:41:16.349119 32103 log.cc:1196] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/590c277324964cfb92a5873a1b16bbd5
I20260808 08:41:16.349552 32103 ts_tablet_manager.cc:1939] T 590c277324964cfb92a5873a1b16bbd5 P 2ef14d1d003c46ad93e1d6ebb082c325: Deleting consensus metadata
I20260808 08:41:16.350476 31181 catalog_manager.cc:4841] TS 2c0958d2ff9e4aeda5345caeb04019a6 (127.19.242.194:37061): tablet 590c277324964cfb92a5873a1b16bbd5 (table test-table [id=ec8b9d9b33444a23a681fc9e9d247a2e]) successfully deleted
I20260808 08:41:16.351011 32107 ts_tablet_manager.cc:1918] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:41:16.351257 32107 log.cc:1196] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/590c277324964cfb92a5873a1b16bbd5
I20260808 08:41:16.351894 32107 ts_tablet_manager.cc:1939] T 590c277324964cfb92a5873a1b16bbd5 P 30a57fcbbdfc4019959539782704eb34: Deleting consensus metadata
I20260808 08:41:16.354300 31182 catalog_manager.cc:4841] TS 2ef14d1d003c46ad93e1d6ebb082c325 (127.19.242.195:40395): tablet 590c277324964cfb92a5873a1b16bbd5 (table test-table [id=ec8b9d9b33444a23a681fc9e9d247a2e]) successfully deleted
I20260808 08:41:16.354967 31183 catalog_manager.cc:4841] TS 30a57fcbbdfc4019959539782704eb34 (127.19.242.193:42919): tablet 590c277324964cfb92a5873a1b16bbd5 (table test-table [id=ec8b9d9b33444a23a681fc9e9d247a2e]) successfully deleted
Aug 08 08:41:16 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.193@KRBTEST.COM
I20260808 08:41:16.375881 32120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:16.350490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59718 (local address 127.19.242.193:42919)
0808 08:41:16.355017 (+ 4527us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:16.355024 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:16.355045 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:41:16.355106 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:16.355111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:16.355196 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:16.355339 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:16.356769 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.357514 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.358889 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.359326 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.359481 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:16.368961 (+ 9480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:16.368979 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:16.368997 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:16.369061 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:16.372348 (+ 3287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:16.373404 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:16.373414 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:16.373416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:16.373575 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:16.374057 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:16.374062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:16.374064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:16.374486 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:16.374847 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:16.375254 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 08:41:16.375507 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4379,"thread_start_us":4159,"threads_started":1}
I20260808 08:41:16.376579 31517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:16.506528 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 31311
I20260808 08:41:16.537915 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 31535
Aug 08 08:41:16 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.194@KRBTEST.COM
I20260808 08:41:16.555701 32122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:16.538905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41518 (local address 127.19.242.194:37061)
0808 08:41:16.539513 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:16.539518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:16.539536 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:41:16.539595 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:16.539599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:16.539669 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:16.539801 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:16.541244 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.542411 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.543975 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.544474 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.544584 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:16.549407 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:16.549426 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:16.549445 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:16.549491 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:16.552816 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:16.553620 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:16.553628 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:16.553631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:16.553786 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:16.554163 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:16.554166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:16.554168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:16.554532 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:16.554862 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:16.555182 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 08:41:16.555408 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":336,"threads_started":1}
I20260808 08:41:16.556514 31719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:16.663328 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 31535
I20260808 08:41:16.691337 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 31731
Aug 08 08:41:16 dist-test-slave-39l8 krb5kdc[31139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.242.195@KRBTEST.COM
I20260808 08:41:16.709287 32124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:16.692321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58326 (local address 127.19.242.195:40395)
0808 08:41:16.692894 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:16.692899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:16.692919 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:41:16.692978 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:16.692981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:16.693042 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:16.693195 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:16.694654 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.695553 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.696867 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:16.697280 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:16.697384 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:16.702524 (+ 5140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:16.702543 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:16.702562 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:16.702612 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:16.705737 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:16.706657 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:16.706665 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:16.706667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:16.706919 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:16.707360 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:16.707364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:16.707366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:16.707950 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:16.708273 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:16.708751 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 08:41:16.708950 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":323,"threads_started":1}
I20260808 08:41:16.710057 31926 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:16.839167 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 31731
I20260808 08:41:16.867928 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 31157
I20260808 08:41:16.869210 31265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:16.991290 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 31157
2026-08-08T08:41:17Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6569 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:41:17 dist-test-slave-39l8 krb5kdc[32132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:41:17 dist-test-slave-39l8 krb5kdc[32132](info): set up 2 sockets
Aug 08 08:41:17 dist-test-slave-39l8 krb5kdc[32132](info): commencing operation
krb5kdc: starting...
W20260808 08:41:18.323360 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.279s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:41:18 dist-test-slave-39l8 krb5kdc[32132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:41:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:41:18.638638 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:38875
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:38875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:19.001753 32151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:19.002089 32151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:19.002184 32151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:19.009690 32151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:19.009824 32151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:19.009872 32151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:19.009924 32151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:19.009975 32151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:19.020699 32151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:38875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:38875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:19.022121 32151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:19.023530 32151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:19.036972 32159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:19.037160 32158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:19.037240 32162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:19.038424 32151 server_base.cc:1034] running on GCE node
I20260808 08:41:19.039645 32151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:19.041385 32151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:19.042763 32151 hybrid_clock.cc:648] HybridClock initialized: now 1786178479042656 us; error 65 us; skew 500 ppm
I20260808 08:41:19.043316 32151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T08:41:19Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2118 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:41:19 dist-test-slave-39l8 krb5kdc[32175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:41:19 dist-test-slave-39l8 krb5kdc[32175](info): set up 2 sockets
Aug 08 08:41:19 dist-test-slave-39l8 krb5kdc[32175](info): commencing operation
krb5kdc: starting...
W20260808 08:41:20.557134 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.394s user 0.005s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:41:20 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:41:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:41:20.887502 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:32881
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:32881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:21.262874 32193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:21.263283 32193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:21.263463 32193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:21.271638 32193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:21.271827 32193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:21.271940 32193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:21.272070 32193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:21.272152 32193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:21.283339 32193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:32881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:32881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:21.284932 32193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:21.286371 32193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:21.299480 32201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:21.299582 32202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:21.299880 32207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:21.300653 32193 server_base.cc:1034] running on GCE node
I20260808 08:41:21.301653 32193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:21.303408 32193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:21.304662 32193 hybrid_clock.cc:648] HybridClock initialized: now 1786178481304600 us; error 43 us; skew 500 ppm
I20260808 08:41:21.305070 32193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:21 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178481, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:21.308871 32193 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:41:21.310796 32193 webserver.cc:460] Webserver started at http://127.19.242.254:42623/ using document root <none> and password file <none>
I20260808 08:41:21.311625 32193 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:21.311770 32193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:21.312160 32193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:21.315706 32193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "ee2d550fcba6439a85e95fb1a8aa0f04"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "2b744c40454ea2ce9ca34b8106feff73"
server_key_iv: "d8d13231c2ec046f662856aa820475f7"
server_key_version: "encryptionkey@0"
I20260808 08:41:21.316648 32193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "ee2d550fcba6439a85e95fb1a8aa0f04"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "2b744c40454ea2ce9ca34b8106feff73"
server_key_iv: "d8d13231c2ec046f662856aa820475f7"
server_key_version: "encryptionkey@0"
I20260808 08:41:21.323287 32193 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:41:21.327524 32215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:21.329265 32193 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:41:21.329504 32193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "ee2d550fcba6439a85e95fb1a8aa0f04"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "2b744c40454ea2ce9ca34b8106feff73"
server_key_iv: "d8d13231c2ec046f662856aa820475f7"
server_key_version: "encryptionkey@0"
I20260808 08:41:21.329744 32193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:21.352942 32193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:21.358981 32193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:21.359570 32193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:21.381729 32193 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:32881
I20260808 08:41:21.381762 32288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:32881 every 8 connection(s)
I20260808 08:41:21.383347 32193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:41:21.386401 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 32193
I20260808 08:41:21.386650 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:41:21.387410 20427 external_mini_cluster.cc:1428] Setting key 015e666a6f6488e4b68961ab2cd4d559
I20260808 08:41:21.387681 32289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:21.404429 32289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Bootstrap starting.
I20260808 08:41:21.408113 32289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Neither blocks nor log segments found. Creating new log.
Aug 08 08:41:21 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:21.409458 32289 log.cc:824] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:21.413015 32289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: No bootstrap required, opened a new log
I20260808 08:41:21.419189 32292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:21.389699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35122 (local address 127.19.242.254:32881)
0808 08:41:21.390656 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:21.390677 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:21.390756 (+ 79us) server_negotiation.cc:407] Connection header received
0808 08:41:21.393671 (+ 2915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:21.393716 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:21.394435 (+ 719us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:21.395050 (+ 615us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:21.396629 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:21.398762 (+ 2133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:21.400197 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:21.401419 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:21.401653 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:21.410188 (+ 8535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:21.410203 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:21.410227 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:21.410305 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:21.413777 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:21.414928 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:21.414940 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:21.414948 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:21.415234 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:21.415733 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:21.415738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:21.415740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:21.416458 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:21.416731 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:21.417300 (+ 569us) server_negotiation.cc:299] Negotiation successful
0808 08:41:21.417853 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":389,"threads_started":1}
I20260808 08:41:21.423233 32289 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:21.423671 32289 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:21.423786 32289 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee2d550fcba6439a85e95fb1a8aa0f04, State: Initialized, Role: FOLLOWER
I20260808 08:41:21.424381 32289 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:21.424649 32289 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:41:21.424804 32289 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:41:21.424988 32289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:21.427479 32289 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:21.428081 32289 leader_election.cc:302] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee2d550fcba6439a85e95fb1a8aa0f04; no voters:
I20260808 08:41:21.428957 32289 leader_election.cc:288] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:41:21.429204 32295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:21.429984 32295 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 LEADER]: Becoming Leader. State: Replica: ee2d550fcba6439a85e95fb1a8aa0f04, State: Running, Role: LEADER
I20260808 08:41:21.430579 32295 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:21.431449 32289 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:21.435173 32298 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee2d550fcba6439a85e95fb1a8aa0f04. Latest consensus state: current_term: 1 leader_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } } }
I20260808 08:41:21.435830 32298 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:21.434892 32297 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } } }
I20260808 08:41:21.436352 32297 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:21.437808 32308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:21.443776 32308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:21.454403 32308 catalog_manager.cc:1347] Generated new cluster ID: ed03c2b7470041ab90ddda8dae3baace
I20260808 08:41:21.454557 32308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:21.471705 32308 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:41:21.473132 32308 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:21.486127 32308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Generated new TSK 0
I20260808 08:41:21.487185 32308 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:41:21.575001 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:32881
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:21.951831 32325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:21.952193 32325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:21.952306 32325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:21.960060 32325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:21.960196 32325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:21.960321 32325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:21.970789 32325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:21.972216 32325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:21.973620 32325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:21.988636 32337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:21.988557 32334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:21.988926 32332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:21.989881 32325 server_base.cc:1034] running on GCE node
I20260808 08:41:21.990597 32325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:21.991732 32325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:21.992985 32325 hybrid_clock.cc:648] HybridClock initialized: now 1786178481992889 us; error 72 us; skew 500 ppm
I20260808 08:41:21.993391 32325 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:21 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178481, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:21.997506 32325 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:41:21.999796 32325 webserver.cc:460] Webserver started at http://127.19.242.193:35093/ using document root <none> and password file <none>
I20260808 08:41:22.000679 32325 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:22.000818 32325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:22.001179 32325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:22.004897 32325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "d7d0bffd3d1449c687168d0a2352b2c3"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "4376f3062913546feef6454d2796bd05"
server_key_iv: "b27f426f11cb2f3d2a02f3754d83958e"
server_key_version: "encryptionkey@0"
I20260808 08:41:22.005930 32325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "d7d0bffd3d1449c687168d0a2352b2c3"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "4376f3062913546feef6454d2796bd05"
server_key_iv: "b27f426f11cb2f3d2a02f3754d83958e"
server_key_version: "encryptionkey@0"
I20260808 08:41:22.012974 32325 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260808 08:41:22.019276 32348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:22.021517 32325 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:41:22.021772 32325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "d7d0bffd3d1449c687168d0a2352b2c3"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "4376f3062913546feef6454d2796bd05"
server_key_iv: "b27f426f11cb2f3d2a02f3754d83958e"
server_key_version: "encryptionkey@0"
I20260808 08:41:22.022049 32325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:22.061618 32325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:22.066089 32325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:22.066434 32325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:22.067605 32325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:22.069101 32325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:22.069240 32325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:22.069406 32325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:22.069483 32325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:22.106035 32325 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:35275
I20260808 08:41:22.106101 32513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:35275 every 8 connection(s)
I20260808 08:41:22.107678 32325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:22.117924 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 32325
I20260808 08:41:22.118124 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:41:22.118839 20427 external_mini_cluster.cc:1428] Setting key 695cd92c03397e45c4dc6f670dbc972f
Aug 08 08:41:22 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178481, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:22.133622 32516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:22.110752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:56921 (local address 127.19.242.254:32881)
0808 08:41:22.111301 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:22.111306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:22.112464 (+ 1158us) server_negotiation.cc:407] Connection header received
0808 08:41:22.114810 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:22.114817 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:22.114932 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:22.115072 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:22.119112 (+ 4040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.119984 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.121915 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.122384 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.122514 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:22.126697 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:22.126766 (+ 69us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:22.126772 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:22.126855 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:22.129722 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:22.130668 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:22.130676 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:22.130684 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:22.130890 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:22.131478 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:22.131483 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:22.131487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:22.131832 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:22.132013 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:22.132902 (+ 889us) server_negotiation.cc:299] Negotiation successful
0808 08:41:22.133195 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":318,"threads_started":1}
I20260808 08:41:22.134910 32517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:22.111470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:56921)
0808 08:41:22.112265 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:22.112317 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:22.114384 (+ 2067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:22.115359 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:22.115369 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:22.116196 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:22.117267 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:22.118786 (+ 1519us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.120167 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.120173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:22.121702 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:22.121716 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.122864 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.122871 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:22.123110 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:22.123892 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:22.123920 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:22.126384 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:22.129928 (+ 3544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:22.129939 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:22.129960 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:22.130500 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:22.131024 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:22.131036 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:22.131040 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:22.131344 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:22.132016 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:22.132039 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:22.132489 (+ 450us) client_negotiation.cc:769] Sending connection context
0808 08:41:22.132787 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 08:41:22.133404 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":300,"threads_started":1}
I20260808 08:41:22.136768 32514 heartbeater.cc:347] Connected to a master server at 127.19.242.254:32881
I20260808 08:41:22.137161 32514 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:22.138140 32514 heartbeater.cc:511] Master 127.19.242.254:32881 requested a full tablet report, sending...
I20260808 08:41:22.141095 32244 ts_manager.cc:194] Registered new tserver with Master: d7d0bffd3d1449c687168d0a2352b2c3 (127.19.242.193:35275)
I20260808 08:41:22.143527 32244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:56921
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:41:22.190271 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:32881
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:22.557791 32520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:22.558207 32520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:22.558401 32520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:22.566692 32520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:22.566927 32520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:22.567132 32520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:22.580884 32520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:22.582309 32520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:22.583838 32520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:22.598378 32530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:22.598381 32531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:22.598868 32534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:22.599493 32520 server_base.cc:1034] running on GCE node
I20260808 08:41:22.600158 32520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:22.601140 32520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:22.602370 32520 hybrid_clock.cc:648] HybridClock initialized: now 1786178482602317 us; error 38 us; skew 500 ppm
I20260808 08:41:22.602794 32520 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:22 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178482, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:22.606405 32520 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:41:22.608506 32520 webserver.cc:460] Webserver started at http://127.19.242.194:35887/ using document root <none> and password file <none>
I20260808 08:41:22.609763 32520 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:22.609927 32520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:22.610345 32520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:22.614156 32520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "742acaea00a542c8a69476bede2dfbc7"
format_stamp: "Formatted at 2026-08-08 08:41:22 on dist-test-slave-39l8"
server_key: "7402af2e4b8c69edaa9a91cc27575615"
server_key_iv: "f8d75156356cde3939e9a64b571a91a4"
server_key_version: "encryptionkey@0"
I20260808 08:41:22.615159 32520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "742acaea00a542c8a69476bede2dfbc7"
format_stamp: "Formatted at 2026-08-08 08:41:22 on dist-test-slave-39l8"
server_key: "7402af2e4b8c69edaa9a91cc27575615"
server_key_iv: "f8d75156356cde3939e9a64b571a91a4"
server_key_version: "encryptionkey@0"
I20260808 08:41:22.621249 32520 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:41:22.625837 32545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:22.627708 32520 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 08:41:22.627928 32520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "742acaea00a542c8a69476bede2dfbc7"
format_stamp: "Formatted at 2026-08-08 08:41:22 on dist-test-slave-39l8"
server_key: "7402af2e4b8c69edaa9a91cc27575615"
server_key_iv: "f8d75156356cde3939e9a64b571a91a4"
server_key_version: "encryptionkey@0"
I20260808 08:41:22.628180 32520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:22.653944 32520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:22.658878 32520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:22.659220 32520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:22.660312 32520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:22.661867 32520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:22.661979 32520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:22.662143 32520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:22.662220 32520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:22.699093 32520 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45567
I20260808 08:41:22.699190 32707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45567 every 8 connection(s)
I20260808 08:41:22.700569 32520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:22.708068 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 32520
I20260808 08:41:22.708317 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:41:22.708786 20427 external_mini_cluster.cc:1428] Setting key 5e28850461a643c780b0bbe60d7d7c3f
Aug 08 08:41:22 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178482, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:22.725099 32711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:22.703611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:52277 (local address 127.19.242.254:32881)
0808 08:41:22.704134 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:22.704138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:22.705215 (+ 1077us) server_negotiation.cc:407] Connection header received
0808 08:41:22.707639 (+ 2424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:22.707646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:22.707759 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:22.707903 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:22.710150 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.711183 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.713194 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.713733 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.713897 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:22.718415 (+ 4518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:22.718422 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:22.718426 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:22.718467 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:22.721351 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:22.722255 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:22.722263 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:22.722271 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:22.722401 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:22.722973 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:22.722978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:22.722981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:22.723382 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:22.723556 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:22.724421 (+ 865us) server_negotiation.cc:299] Negotiation successful
0808 08:41:22.724719 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":295,"threads_started":1}
I20260808 08:41:22.726492 32713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:22.704095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:52277)
0808 08:41:22.704942 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:22.705002 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:22.707213 (+ 2211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:22.708262 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:22.708276 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:22.709057 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:22.709914 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:22.709952 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.711391 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.711396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:22.712990 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:22.713008 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:22.714018 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:22.714026 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:22.714320 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:22.715202 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:22.715231 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:22.718043 (+ 2812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:22.721541 (+ 3498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:22.721552 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:22.721573 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:22.722097 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:22.722539 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:22.722544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:22.722548 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:22.722849 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:22.723558 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:22.723569 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:22.724002 (+ 433us) client_negotiation.cc:769] Sending connection context
0808 08:41:22.724316 (+ 314us) client_negotiation.cc:240] Negotiation successful
0808 08:41:22.724939 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":333,"threads_started":1}
I20260808 08:41:22.728199 32708 heartbeater.cc:347] Connected to a master server at 127.19.242.254:32881
I20260808 08:41:22.728564 32708 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:22.729372 32708 heartbeater.cc:511] Master 127.19.242.254:32881 requested a full tablet report, sending...
I20260808 08:41:22.731120 32244 ts_manager.cc:194] Registered new tserver with Master: 742acaea00a542c8a69476bede2dfbc7 (127.19.242.194:45567)
I20260808 08:41:22.732239 32244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:52277
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:41:22.778522 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:32881
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:23.148275 32514 heartbeater.cc:503] Master 127.19.242.254:32881 was elected leader, sending a full tablet report...
W20260808 08:41:23.159998 32717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:23.160369 32717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:23.160593 32717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:23.168399 32717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:23.168540 32717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:23.168721 32717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:23.179351 32717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:23.180832 32717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:23.182261 32717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:23.197252 32724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:23.197266 32723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:23.197301 32730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:23.198173 32717 server_base.cc:1034] running on GCE node
I20260808 08:41:23.199021 32717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:23.200192 32717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:23.201442 32717 hybrid_clock.cc:648] HybridClock initialized: now 1786178483201390 us; error 50 us; skew 500 ppm
I20260808 08:41:23.201802 32717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:23 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178483, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:23.205787 32717 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:41:23.207695 32717 webserver.cc:460] Webserver started at http://127.19.242.195:39275/ using document root <none> and password file <none>
I20260808 08:41:23.208509 32717 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:23.208673 32717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:23.209025 32717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:23.212435 32717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "f0eb3829bbfb495cb060016f1fe2e94c"
format_stamp: "Formatted at 2026-08-08 08:41:23 on dist-test-slave-39l8"
server_key: "2bb84ddac01597fc244210ec32ca94c4"
server_key_iv: "7950954a302b9cb317abd91a3ab02e83"
server_key_version: "encryptionkey@0"
I20260808 08:41:23.213354 32717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "f0eb3829bbfb495cb060016f1fe2e94c"
format_stamp: "Formatted at 2026-08-08 08:41:23 on dist-test-slave-39l8"
server_key: "2bb84ddac01597fc244210ec32ca94c4"
server_key_iv: "7950954a302b9cb317abd91a3ab02e83"
server_key_version: "encryptionkey@0"
I20260808 08:41:23.219412 32717 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:41:23.223562 32741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:23.225378 32717 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:41:23.225601 32717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "f0eb3829bbfb495cb060016f1fe2e94c"
format_stamp: "Formatted at 2026-08-08 08:41:23 on dist-test-slave-39l8"
server_key: "2bb84ddac01597fc244210ec32ca94c4"
server_key_iv: "7950954a302b9cb317abd91a3ab02e83"
server_key_version: "encryptionkey@0"
I20260808 08:41:23.225912 32717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:23.242172 32717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:23.247532 32717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:23.247857 32717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:23.248986 32717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:23.250628 32717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:23.250792 32717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 08:41:23.250993 32717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:23.251082 32717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:23.287922 32717 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:46651
I20260808 08:41:23.287961 438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:46651 every 8 connection(s)
I20260808 08:41:23.289441 32717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:23.292191 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 32717
I20260808 08:41:23.292407 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:41:23.292966 20427 external_mini_cluster.cc:1428] Setting key 019267f0ea3fbdd60e683ac618e0beee
Aug 08 08:41:23 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178483, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:23.314327 442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:23.292588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58017 (local address 127.19.242.254:32881)
0808 08:41:23.293180 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:23.293185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:23.294503 (+ 1318us) server_negotiation.cc:407] Connection header received
0808 08:41:23.297215 (+ 2712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:23.297221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:23.297548 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:23.297741 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:23.299668 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.300482 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.302276 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.302801 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.302953 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:23.307108 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:23.307114 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:23.307117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:23.307165 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:23.310562 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.311611 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.311616 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.311619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.311775 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.312321 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.312325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.312327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.312664 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:23.312813 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:23.313797 (+ 984us) server_negotiation.cc:299] Negotiation successful
0808 08:41:23.314000 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":280,"threads_started":1}
I20260808 08:41:23.315619 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:23.293159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:58017)
0808 08:41:23.294327 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:23.294380 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:23.296871 (+ 2491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:23.298051 (+ 1180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:23.298062 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:23.298694 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:23.299460 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:23.299480 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.300681 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.300685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:23.302099 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:23.302115 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.303074 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.303082 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:23.303346 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:23.304084 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:23.304109 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:23.306817 (+ 2708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:23.310812 (+ 3995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:23.310824 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:23.310846 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:23.311438 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:23.311922 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:23.311926 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:23.311928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:23.312178 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:23.312826 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:23.312835 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:23.313346 (+ 511us) client_negotiation.cc:769] Sending connection context
0808 08:41:23.313642 (+ 296us) client_negotiation.cc:240] Negotiation successful
0808 08:41:23.314148 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":468,"threads_started":1}
I20260808 08:41:23.317492 440 heartbeater.cc:347] Connected to a master server at 127.19.242.254:32881
I20260808 08:41:23.317880 440 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:23.318769 440 heartbeater.cc:511] Master 127.19.242.254:32881 requested a full tablet report, sending...
I20260808 08:41:23.320685 32244 ts_manager.cc:194] Registered new tserver with Master: f0eb3829bbfb495cb060016f1fe2e94c (127.19.242.195:46651)
I20260808 08:41:23.321817 32244 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:58017
I20260808 08:41:23.323357 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab.
Entry for principal oryx/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab.
WARNING: no policy specified for oryx/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab.
Entry for principal oryx/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab.
WARNING: no policy specified for oryx/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab.
Entry for principal oryx/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab.
I20260808 08:41:23.517177 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 32325
Aug 08 08:41:23 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:41:23.536513 453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:23.518584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59424 (local address 127.19.242.193:35275)
0808 08:41:23.519366 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:23.519373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:23.519401 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:41:23.519481 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:23.519487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:23.519701 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:23.519849 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:23.521342 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.522415 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.523757 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.524387 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.524499 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:23.529336 (+ 4837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:23.529350 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:23.529367 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:23.529413 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:23.533209 (+ 3796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.534206 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.534216 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.534220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.534391 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.534924 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.534927 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.534929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.535370 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:23.535619 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:23.535977 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:41:23.536192 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":429,"threads_started":1}
I20260808 08:41:23.537890 32504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:23.625240 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 32325
I20260808 08:41:23.653730 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 32520
Aug 08 08:41:23 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:41:23.671996 456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:23.654678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36328 (local address 127.19.242.194:45567)
0808 08:41:23.655274 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:23.655281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:23.655308 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:41:23.655371 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:23.655377 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:23.655610 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:23.655850 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:23.657256 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.658308 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.659799 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.660403 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.660577 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:23.665307 (+ 4730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:23.665325 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:23.665342 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:23.665392 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:23.668744 (+ 3352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.669600 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.669609 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.669611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.669765 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.670185 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.670190 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.670192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.670662 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:23.671052 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:23.671370 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 08:41:23.671634 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":275,"threads_started":1}
I20260808 08:41:23.673432 32703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:23.759030 32708 heartbeater.cc:503] Master 127.19.242.254:32881 was elected leader, sending a full tablet report...
I20260808 08:41:23.760480 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 32520
W20260808 08:41:23.784710 32216 connection.cc:535] server connection from 127.19.242.194:52277 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:41:23.785101 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 32717
Aug 08 08:41:23 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:41:23.804991 458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:23.786164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53284 (local address 127.19.242.195:46651)
0808 08:41:23.786804 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:23.786817 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:23.786857 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:41:23.786924 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:23.786931 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:23.787158 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:23.787349 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:23.788816 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.789853 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.791416 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:23.792313 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:23.792482 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:23.798032 (+ 5550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:23.798052 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:23.798070 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:23.798116 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:23.801439 (+ 3323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.802364 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.802373 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.802375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.802525 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:23.803174 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:23.803180 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:23.803183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:23.803579 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:23.803939 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:23.804293 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 08:41:23.804600 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":280,"threads_started":1}
I20260808 08:41:23.806411 428 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:23.893786 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 32717
I20260808 08:41:23.920377 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 32193
I20260808 08:41:23.921886 32283 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:24.034552 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 32193
I20260808 08:41:24.067920 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:32881
--webserver_interface=127.19.242.254
--webserver_port=42623
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:32881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:24.433044 462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:24.433396 462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:24.433560 462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:24.441185 462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:24.441321 462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:24.441426 462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:24.441540 462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:24.441625 462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:24.452085 462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:32881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:32881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=42623
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:24.453559 462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:24.455013 462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:24.467679 471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:24.467770 472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:24.467833 475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:24.468555 462 server_base.cc:1034] running on GCE node
I20260808 08:41:24.469461 462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:24.471038 462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:24.472290 462 hybrid_clock.cc:648] HybridClock initialized: now 1786178484472230 us; error 52 us; skew 500 ppm
I20260808 08:41:24.472661 462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:24 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:24.476122 462 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:41:24.478070 462 webserver.cc:460] Webserver started at http://127.19.242.254:42623/ using document root <none> and password file <none>
I20260808 08:41:24.478950 462 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:24.479131 462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:24.485344 462 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:41:24.488722 486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:24.490366 462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:41:24.490607 462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "ee2d550fcba6439a85e95fb1a8aa0f04"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "2b744c40454ea2ce9ca34b8106feff73"
server_key_iv: "d8d13231c2ec046f662856aa820475f7"
server_key_version: "encryptionkey@0"
I20260808 08:41:24.491814 462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:24.510036 462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:24.514784 462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:24.515115 462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:24.536479 462 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:32881
I20260808 08:41:24.536492 555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:32881 every 8 connection(s)
I20260808 08:41:24.538192 462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:41:24.541211 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 462
I20260808 08:41:24.542290 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:35275
--local_ip_for_outbound_sockets=127.19.242.193
--tserver_master_addrs=127.19.242.254:32881
--webserver_port=35093
--webserver_interface=127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:41:24.548280 557 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:41:24.553911 557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Bootstrap starting.
I20260808 08:41:24.574476 557 log.cc:824] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:24.584339 557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:41:24.584971 557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Bootstrap complete.
I20260808 08:41:24.594681 557 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:24.595853 557 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee2d550fcba6439a85e95fb1a8aa0f04, State: Initialized, Role: FOLLOWER
I20260808 08:41:24.596622 557 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:24.596913 557 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:41:24.597056 557 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:41:24.597261 557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:41:24.601732 557 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:24.602386 557 leader_election.cc:302] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee2d550fcba6439a85e95fb1a8aa0f04; no voters:
I20260808 08:41:24.603178 557 leader_election.cc:288] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:41:24.603338 564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:41:24.604141 564 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [term 2 LEADER]: Becoming Leader. State: Replica: ee2d550fcba6439a85e95fb1a8aa0f04, State: Running, Role: LEADER
I20260808 08:41:24.604844 564 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } }
I20260808 08:41:24.605659 557 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:24.607982 566 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } } }
I20260808 08:41:24.608673 566 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:24.608251 565 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee2d550fcba6439a85e95fb1a8aa0f04. Latest consensus state: current_term: 2 leader_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee2d550fcba6439a85e95fb1a8aa0f04" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32881 } } }
I20260808 08:41:24.609061 565 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:24.621882 570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:24.629832 570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:24.631886 570 catalog_manager.cc:1259] Loaded cluster ID: ed03c2b7470041ab90ddda8dae3baace
I20260808 08:41:24.632181 570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:24.637195 570 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:24.639259 570 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ee2d550fcba6439a85e95fb1a8aa0f04: Loaded TSK: 0
I20260808 08:41:24.641083 570 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:41:24.933861 559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:24.934255 559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:24.934417 559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:24.942329 559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:24.942525 559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:24.942790 559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:24.953604 559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.193.keytab
--principal=oryx/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:35275
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=35093
--tserver_master_addrs=127.19.242.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:24.955168 559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:24.956635 559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:24.971288 597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:24.971639 596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:24.972106 605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:24.976806 559 server_base.cc:1034] running on GCE node
I20260808 08:41:24.977739 559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:24.979168 559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:24.980445 559 hybrid_clock.cc:648] HybridClock initialized: now 1786178484980353 us; error 84 us; skew 500 ppm
I20260808 08:41:24.980857 559 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:24 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178484, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:24.986589 559 init.cc:377] Logged in from keytab as oryx/127.19.242.193@KRBTEST.COM (short username oryx)
I20260808 08:41:24.988862 559 webserver.cc:460] Webserver started at http://127.19.242.193:35093/ using document root <none> and password file <none>
I20260808 08:41:24.989948 559 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:24.990142 559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:24.998171 559 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 08:41:25.001969 615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:25.003716 559 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 08:41:25.003928 559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "d7d0bffd3d1449c687168d0a2352b2c3"
format_stamp: "Formatted at 2026-08-08 08:41:21 on dist-test-slave-39l8"
server_key: "4376f3062913546feef6454d2796bd05"
server_key_iv: "b27f426f11cb2f3d2a02f3754d83958e"
server_key_version: "encryptionkey@0"
I20260808 08:41:25.005016 559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:25.034456 559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:25.039512 559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:25.039830 559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:25.040959 559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:25.042582 559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:25.042686 559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:25.042869 559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:25.042943 559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:25.083740 559 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:35275
I20260808 08:41:25.083853 780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:35275 every 8 connection(s)
I20260808 08:41:25.085465 559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:25.086325 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 559
I20260808 08:41:25.087085 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:45567
--local_ip_for_outbound_sockets=127.19.242.194
--tserver_master_addrs=127.19.242.254:32881
--webserver_port=35887
--webserver_interface=127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:41:25.117151 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:25.090008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:34501 (local address 127.19.242.254:32881)
0808 08:41:25.095428 (+ 5420us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:25.095445 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:25.097165 (+ 1720us) server_negotiation.cc:407] Connection header received
0808 08:41:25.100059 (+ 2894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:25.100073 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:25.100502 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:25.100959 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:25.102947 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.105045 (+ 2098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.107149 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.108446 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.108684 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.116073 (+ 7389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:34501: BlockingRecv error: recv got EOF from 127.19.242.193:34501 (error 108)
Metrics: {"server-negotiator.queue_time_us":5078,"thread_start_us":4790,"threads_started":1}
I20260808 08:41:25.117251 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:25.090028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:34501)
0808 08:41:25.096899 (+ 6871us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:25.096965 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:25.099257 (+ 2292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:25.101156 (+ 1899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:25.101168 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:25.101897 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:25.102522 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.102544 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.105298 (+ 2754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.105304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.106943 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.106961 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.108777 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.108784 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.109134 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.110173 (+ 1039us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:25.110202 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:25.115673 (+ 5471us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6454,"thread_start_us":6148,"threads_started":1}
W20260808 08:41:25.118422 782 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:32881 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.242.254:32881: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:25.137418 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:25.119312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:37317)
0808 08:41:25.119530 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:25.119557 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:25.119748 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:25.120177 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:25.120182 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:25.120702 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:25.120997 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.121017 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.122882 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.122887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.124032 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.124049 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.125076 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.125085 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.125229 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.125917 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:25.125936 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:25.137172 (+ 11236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 08:41:25.137775 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:25.119466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:37317 (local address 127.19.242.254:32881)
0808 08:41:25.119699 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:25.119705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:25.119729 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:41:25.119944 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:25.119948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:25.120018 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:25.120148 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:25.121245 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.122628 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.124216 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.124867 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.125023 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.137542 (+ 12519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:37317: BlockingRecv error: recv got EOF from 127.19.242.193:37317 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:25.148307 786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:25.138429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:36219)
0808 08:41:25.138656 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:25.138679 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:25.138857 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:25.139224 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:25.139229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:25.139681 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:25.139900 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.139912 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.140991 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.140997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.142424 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.142441 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.143470 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.143477 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.143663 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.144393 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:25.144417 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:25.147951 (+ 3534us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":78}
W20260808 08:41:25.148466 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:25.138505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:36219 (local address 127.19.242.254:32881)
0808 08:41:25.138693 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:25.138698 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:25.138775 (+ 77us) server_negotiation.cc:407] Connection header received
0808 08:41:25.138996 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:25.138999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:25.139065 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:25.139154 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:25.140066 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.140823 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.142594 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.143295 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.143404 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.148206 (+ 4802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:36219: BlockingRecv error: recv got EOF from 127.19.242.193:36219 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 08:41:25.148705 782 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:41:25.465440 789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:25.465808 789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:25.465996 789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:25.473515 789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:25.473729 789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:25.473872 789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:25.484884 789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.194.keytab
--principal=oryx/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:45567
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=35887
--tserver_master_addrs=127.19.242.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:25.486284 789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:25.487653 789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:25.502646 799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:25.502662 802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:25.502646 798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:25.503943 789 server_base.cc:1034] running on GCE node
I20260808 08:41:25.504834 789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:25.506021 789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:25.507289 789 hybrid_clock.cc:648] HybridClock initialized: now 1786178485507226 us; error 77 us; skew 500 ppm
I20260808 08:41:25.507673 789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178485, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:25.511631 789 init.cc:377] Logged in from keytab as oryx/127.19.242.194@KRBTEST.COM (short username oryx)
I20260808 08:41:25.513530 789 webserver.cc:460] Webserver started at http://127.19.242.194:35887/ using document root <none> and password file <none>
I20260808 08:41:25.514345 789 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:25.514529 789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:25.521306 789 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:41:25.525107 811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:25.527050 789 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:41:25.527369 789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "742acaea00a542c8a69476bede2dfbc7"
format_stamp: "Formatted at 2026-08-08 08:41:22 on dist-test-slave-39l8"
server_key: "7402af2e4b8c69edaa9a91cc27575615"
server_key_iv: "f8d75156356cde3939e9a64b571a91a4"
server_key_version: "encryptionkey@0"
I20260808 08:41:25.528512 789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:25.568097 789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:25.573094 789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:25.573446 789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:25.574666 789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:25.576381 789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:25.576529 789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:25.576700 789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:25.576809 789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:25.616374 789 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45567
I20260808 08:41:25.616477 973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45567 every 8 connection(s)
I20260808 08:41:25.618330 789 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:25.627267 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 789
I20260808 08:41:25.627990 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:46651
--local_ip_for_outbound_sockets=127.19.242.195
--tserver_master_addrs=127.19.242.254:32881
--webserver_port=39275
--webserver_interface=127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:41:25.638738 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:25.621449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:55227 (local address 127.19.242.254:32881)
0808 08:41:25.621688 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:25.621693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:25.623256 (+ 1563us) server_negotiation.cc:407] Connection header received
0808 08:41:25.625442 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:25.625447 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:25.625532 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:25.625652 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:25.627660 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.628493 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.631316 (+ 2823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.631753 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.631864 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.638431 (+ 6567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:55227: BlockingRecv error: recv got EOF from 127.19.242.194:55227 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:41:25.639623 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:25.622090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:55227)
0808 08:41:25.623049 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:25.623105 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:25.625103 (+ 1998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:25.625892 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:25.625901 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:25.626478 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:25.627378 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.627412 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.628703 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.628712 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.631100 (+ 2388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.631123 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.632032 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.632043 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.632419 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.633331 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:25.633370 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:25.638196 (+ 4826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":383,"threads_started":1}
W20260808 08:41:25.640441 974 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:32881 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.242.254:32881: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:25.651751 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:25.641175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:47383)
0808 08:41:25.641393 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:25.641419 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:25.641578 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:25.641961 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:25.641969 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:25.642506 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:25.642791 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.642809 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.643968 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.643977 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.645662 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.645684 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.646575 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.646584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.646840 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.647560 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:25.647588 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:25.651419 (+ 3831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 08:41:25.651957 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:25.641399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:47383 (local address 127.19.242.254:32881)
0808 08:41:25.641561 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:25.641567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:25.641588 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:41:25.641726 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:25.641730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:25.641795 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:25.641891 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:25.643019 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.643788 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.645869 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.646376 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.646497 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.651686 (+ 5189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:47383: BlockingRecv error: recv got EOF from 127.19.242.194:47383 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:25 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:25.663599 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:25.652578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:60375)
0808 08:41:25.652808 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:25.652836 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:25.652977 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:25.653486 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:25.653493 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:25.653976 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:25.654231 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.654249 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.655407 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.655415 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.657268 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:25.657291 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.658117 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.658126 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:25.658391 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.659219 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:25.659252 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:25.663257 (+ 4005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 08:41:25.663771 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:25.652738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:60375 (local address 127.19.242.254:32881)
0808 08:41:25.652883 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:25.652887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:25.652906 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:41:25.653223 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:25.653227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:25.653313 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:25.653406 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:25.654397 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.655240 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.657473 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:25.657932 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:25.658042 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:25.663522 (+ 5480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:60375: BlockingRecv error: recv got EOF from 127.19.242.194:60375 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 08:41:25.664116 974 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:41:26.028026 977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:26.028434 977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:26.028616 977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:26.037871 977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:26.038074 977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:26.038286 977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:26.049767 977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/krb5kdc/oryx_127.19.242.195.keytab
--principal=oryx/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:46651
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=39275
--tserver_master_addrs=127.19.242.254:32881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:26.051357 977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:26.052838 977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:26.067525 984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:26.067608 989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:26.067631 985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:26.068966 977 server_base.cc:1034] running on GCE node
I20260808 08:41:26.069803 977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:26.071062 977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:26.072358 977 hybrid_clock.cc:648] HybridClock initialized: now 1786178486072311 us; error 62 us; skew 500 ppm
I20260808 08:41:26.072729 977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178486, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:26.076640 977 init.cc:377] Logged in from keytab as oryx/127.19.242.195@KRBTEST.COM (short username oryx)
I20260808 08:41:26.078493 977 webserver.cc:460] Webserver started at http://127.19.242.195:39275/ using document root <none> and password file <none>
I20260808 08:41:26.079370 977 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:26.079507 977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:26.086226 977 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:41:26.089637 996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:26.091404 977 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 08:41:26.091621 977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "f0eb3829bbfb495cb060016f1fe2e94c"
format_stamp: "Formatted at 2026-08-08 08:41:23 on dist-test-slave-39l8"
server_key: "2bb84ddac01597fc244210ec32ca94c4"
server_key_iv: "7950954a302b9cb317abd91a3ab02e83"
server_key_version: "encryptionkey@0"
I20260808 08:41:26.092727 977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:26.113260 977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:26.118183 977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:26.118556 977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:26.119716 977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:26.121212 977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:26.121357 977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:26.121501 977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:26.121589 977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:26.162461 1114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:26.149488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:59101)
0808 08:41:26.150047 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:26.150074 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:26.150245 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:26.150839 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:26.150848 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:26.151535 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:26.151859 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.151871 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.153452 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.153458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.154657 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.154679 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.156131 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.156139 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.156359 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.157161 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:26.157198 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:26.161870 (+ 4672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":308,"threads_started":1}
W20260808 08:41:26.162493 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:26.150074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:59101 (local address 127.19.242.254:32881)
0808 08:41:26.150325 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:26.150335 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:26.150366 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:41:26.150457 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:26.150467 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:26.150604 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:26.150793 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:26.152089 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.153287 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.154886 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.155827 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.156004 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.162251 (+ 6247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:59101: BlockingRecv error: recv got EOF from 127.19.242.193:59101 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 08:41:26.167228 977 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:46651
I20260808 08:41:26.167299 1161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:46651 every 8 connection(s)
I20260808 08:41:26.168834 977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:26.176752 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 977
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:41:26.188791 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:26.172201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:52113 (local address 127.19.242.254:32881)
0808 08:41:26.172413 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:26.172419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:26.173865 (+ 1446us) server_negotiation.cc:407] Connection header received
0808 08:41:26.176140 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:26.176147 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:26.176292 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:26.176419 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:26.178765 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.179733 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.181698 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.182232 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.182397 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.188441 (+ 6044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:52113: BlockingRecv error: recv got EOF from 127.19.242.195:52113 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:41:26.189797 1165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:26.172695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:52113)
0808 08:41:26.173614 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:26.173671 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:26.175786 (+ 2115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:26.176730 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:26.176740 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:26.177425 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:26.178376 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.178418 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.179980 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.179985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.181477 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.181492 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.182534 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.182544 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.182939 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.183790 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:26.183818 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:26.188217 (+ 4399us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":402,"threads_started":1}
W20260808 08:41:26.191040 1162 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:32881 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.242.254:32881: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
I20260808 08:41:26.197281 1169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:26.177987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35132 (local address 127.19.242.254:32881)
0808 08:41:26.178873 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:26.178881 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:26.179323 (+ 442us) server_negotiation.cc:407] Connection header received
0808 08:41:26.179562 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:26.179568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:26.179644 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:26.179774 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:26.181525 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.182506 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.184254 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.184741 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.184897 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.188228 (+ 3331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:26.188239 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:26.188260 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:26.188309 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:26.192891 (+ 4582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:26.194022 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:26.194030 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:26.194038 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:26.194257 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:26.194826 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:26.194831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:26.194834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:26.195575 (+ 741us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:26.195928 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:26.196434 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 08:41:26.196844 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":487,"threads_started":1}
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:26.202099 1165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:26.191787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:47673)
0808 08:41:26.192025 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:26.192049 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:26.192178 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:26.192609 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:26.192612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:26.192952 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:26.193111 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.193120 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.194608 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.194613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.196103 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.196123 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.197337 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.197346 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.197567 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.198282 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:26.198310 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:26.201787 (+ 3477us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 08:41:26.202277 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:26.191923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:47673 (local address 127.19.242.254:32881)
0808 08:41:26.192254 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:26.192261 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:26.192285 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:41:26.192364 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:26.192370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:26.192456 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:26.192587 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:26.193276 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.194437 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.196381 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.197154 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.197281 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.202013 (+ 4732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:47673: BlockingRecv error: recv got EOF from 127.19.242.195:47673 (error 108)
Metrics: {"server-negotiator.queue_time_us":181}
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:26.211601 1165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:26.202944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:41875)
0808 08:41:26.203158 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:26.203180 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:26.203372 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:26.203716 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:26.203720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:26.204070 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:26.204229 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.204237 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.205284 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.205290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.206275 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.206287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.207160 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.207167 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.207392 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.208072 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:26.208091 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:26.211255 (+ 3164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:41:26.211783 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:26.203007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:41875 (local address 127.19.242.254:32881)
0808 08:41:26.203181 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:26.203187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:26.203295 (+ 108us) server_negotiation.cc:407] Connection header received
0808 08:41:26.203497 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:26.203502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:26.203579 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:26.203684 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:26.204393 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.205119 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.206429 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.206999 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.207143 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.211525 (+ 4382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:41875: BlockingRecv error: recv got EOF from 127.19.242.195:41875 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 08:41:26.212219 1162 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:26 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:26.679060 1171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:26.664885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:53763)
0808 08:41:26.665481 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:26.665502 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:26.665692 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:26.666063 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:26.666068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:26.666751 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:26.666969 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.666979 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.668006 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.668011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.668998 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:26.669011 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.669802 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.669811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:26.669989 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.675076 (+ 5087us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:26.675100 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:26.678682 (+ 3582us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":297,"threads_started":1}
W20260808 08:41:26.679183 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:26.664976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:53763 (local address 127.19.242.254:32881)
0808 08:41:26.665266 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:26.665275 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:26.665596 (+ 321us) server_negotiation.cc:407] Connection header received
0808 08:41:26.665838 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:26.665842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:26.665906 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:26.666011 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:26.667125 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.667850 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.669179 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:26.669588 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:26.669732 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:26.678926 (+ 9194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:53763: BlockingRecv error: recv got EOF from 127.19.242.194:53763 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 08:41:27 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:27 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:27.173453 1172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:27.163735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:33895)
0808 08:41:27.164433 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:27.164456 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:27.164607 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:27.164941 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:27.164944 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:27.165530 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:27.165832 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:27.165849 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.167326 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.167333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:27.168257 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:27.168270 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.169051 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.169057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:27.169244 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:27.169934 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:27.169954 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:27.173071 (+ 3117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":399,"threads_started":1}
W20260808 08:41:27.173571 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:27.163878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:33895 (local address 127.19.242.254:32881)
0808 08:41:27.164160 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:27.164169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:27.164558 (+ 389us) server_negotiation.cc:407] Connection header received
0808 08:41:27.164734 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:27.164738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:27.164803 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:27.164887 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:27.166046 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.167150 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.168429 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.168872 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.169021 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:27.173330 (+ 4309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:33895: BlockingRecv error: recv got EOF from 127.19.242.193:33895 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 08 08:41:27 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:27 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:27.222617 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:27.213067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:45735)
0808 08:41:27.213671 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:27.213695 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:27.213870 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:27.214524 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:27.214529 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:27.215235 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:27.215450 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:27.215460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.216523 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.216527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:27.217507 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:27.217520 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.218364 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.218369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:27.218494 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:27.219261 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:27.219281 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:27.222336 (+ 3055us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":302,"threads_started":1}
W20260808 08:41:27.223013 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:27.213145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:45735 (local address 127.19.242.254:32881)
0808 08:41:27.213450 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:27.213456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:27.213813 (+ 357us) server_negotiation.cc:407] Connection header received
0808 08:41:27.214129 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:27.214135 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:27.214228 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:27.214345 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:27.215616 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.216381 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.217672 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.218181 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.218291 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:27.222652 (+ 4361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:45735: BlockingRecv error: recv got EOF from 127.19.242.195:45735 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 08:41:27 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:27 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:27.690348 1176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:27.680358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:41245)
0808 08:41:27.680997 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:27.681018 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:27.681151 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:27.681584 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:27.681588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:27.682054 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:27.682248 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:27.682259 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.683490 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.683496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:27.684570 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:27.684587 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.685531 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.685539 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:27.685728 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:27.686488 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:27.686514 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:27.690081 (+ 3567us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":360,"threads_started":1}
W20260808 08:41:27.690742 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:27.680540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:41245 (local address 127.19.242.254:32881)
0808 08:41:27.680766 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:27.680774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:27.681118 (+ 344us) server_negotiation.cc:407] Connection header received
0808 08:41:27.681285 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:27.681289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:27.681361 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:27.681458 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:27.682442 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.683276 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.684762 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:27.685350 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:27.685462 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:27.690416 (+ 4954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:41245: BlockingRecv error: recv got EOF from 127.19.242.194:41245 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 08:41:28 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:28 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:28.183998 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:28.174686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:40305)
0808 08:41:28.175283 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:28.175305 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:28.175459 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:28.175924 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:28.175935 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:28.176305 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:28.176476 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:28.176485 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.177682 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.177687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:28.178785 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:28.178811 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.179632 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.179636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:28.179805 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:28.180571 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:28.180590 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:28.183690 (+ 3100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":288,"threads_started":1}
W20260808 08:41:28.184407 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:28.174908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:40305 (local address 127.19.242.254:32881)
0808 08:41:28.175138 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:28.175144 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:28.175437 (+ 293us) server_negotiation.cc:407] Connection header received
0808 08:41:28.175592 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:28.175598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:28.175729 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:28.175852 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:28.176638 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.177502 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.178963 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.179455 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.179588 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:28.183993 (+ 4405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:40305: BlockingRecv error: recv got EOF from 127.19.242.193:40305 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 08 08:41:28 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:28 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:28.233846 1178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:28.223886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:46741)
0808 08:41:28.224490 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:28.224508 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:28.224754 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:28.225195 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:28.225201 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:28.225857 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:28.226110 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:28.226126 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.227578 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.227583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:28.228520 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:28.228534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.229304 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.229309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:28.229432 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:28.230069 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:28.230088 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:28.233412 (+ 3324us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":339,"threads_started":1}
W20260808 08:41:28.233942 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:28.224007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:46741 (local address 127.19.242.254:32881)
0808 08:41:28.224307 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:28.224314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:28.224628 (+ 314us) server_negotiation.cc:407] Connection header received
0808 08:41:28.224903 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:28.224909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:28.225001 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:28.225113 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:28.226324 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.227405 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.228704 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.229109 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.229221 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:28.233738 (+ 4517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:46741: BlockingRecv error: recv got EOF from 127.19.242.195:46741 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 08 08:41:28 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:28 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:28.701579 1184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:28.691783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:49809)
0808 08:41:28.692406 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:28.692429 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:28.692614 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:28.693091 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:28.693095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:28.693611 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:28.693858 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:28.693874 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.695038 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.695043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:28.696447 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:28.696463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.697304 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.697309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:28.697450 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:28.698108 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:28.698126 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:28.701282 (+ 3156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":336,"threads_started":1}
W20260808 08:41:28.701777 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:28.691941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:49809 (local address 127.19.242.254:32881)
0808 08:41:28.692208 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:28.692214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:28.692519 (+ 305us) server_negotiation.cc:407] Connection header received
0808 08:41:28.692799 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:28.692807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:28.692921 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:28.693012 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:28.694032 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.694885 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.696595 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:28.697141 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:28.697271 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:28.701524 (+ 4253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:49809: BlockingRecv error: recv got EOF from 127.19.242.194:49809 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 08 08:41:29 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:29 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:29.193878 1185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:29.185147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:43579)
0808 08:41:29.185892 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:29.185914 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:29.186076 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:29.186537 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:29.186542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:29.187105 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:29.187267 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:29.187277 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.188269 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.188273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:29.189223 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:29.189233 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.189903 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.189907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:29.190025 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:29.190724 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:29.190745 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:29.193636 (+ 2891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":452,"threads_started":1}
W20260808 08:41:29.194129 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:29.185256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:43579 (local address 127.19.242.254:32881)
0808 08:41:29.185456 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:29.185464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:29.186050 (+ 586us) server_negotiation.cc:407] Connection header received
0808 08:41:29.186242 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:29.186251 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:29.186375 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:29.186464 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:29.187416 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.188150 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.189357 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.189769 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.189867 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:29.193895 (+ 4028us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:43579: BlockingRecv error: recv got EOF from 127.19.242.193:43579 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 08:41:29 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:29 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:29.244180 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:29.235123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:50685)
0808 08:41:29.235790 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:29.235813 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:29.235967 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:29.236378 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:29.236384 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:29.236827 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:29.237005 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:29.237015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.238126 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.238132 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:29.239120 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:29.239134 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.239893 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.239900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:29.240094 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:29.240716 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:29.240763 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:29.243790 (+ 3027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":352,"threads_started":1}
W20260808 08:41:29.244328 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:29.235240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:50685 (local address 127.19.242.254:32881)
0808 08:41:29.235484 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:29.235493 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:29.235892 (+ 399us) server_negotiation.cc:407] Connection header received
0808 08:41:29.236107 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:29.236119 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:29.236187 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:29.236339 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:29.237163 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.237961 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.239277 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.239723 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.239873 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:29.244051 (+ 4178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:50685: BlockingRecv error: recv got EOF from 127.19.242.195:50685 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 08 08:41:29 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:29 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:29.712594 1192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:29.702870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:59555)
0808 08:41:29.703417 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:29.703434 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:29.703567 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:29.703891 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:29.703894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:29.704305 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:29.704464 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:29.704473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.706056 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.706062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:29.707544 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:29.707559 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.708368 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.708373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:29.708497 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:29.709239 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:29.709259 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:29.712345 (+ 3086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":297,"threads_started":1}
W20260808 08:41:29.712791 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:29.702971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:59555 (local address 127.19.242.254:32881)
0808 08:41:29.703282 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:29.703289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:29.703529 (+ 240us) server_negotiation.cc:407] Connection header received
0808 08:41:29.703682 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:29.703686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:29.703754 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:29.703844 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:29.704638 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.705864 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.707724 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:29.708214 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:29.708326 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:29.712563 (+ 4237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:59555: BlockingRecv error: recv got EOF from 127.19.242.194:59555 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 08 08:41:30 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:30 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:30.204276 1193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:30.195070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:59421)
0808 08:41:30.195724 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:30.195743 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:30.195873 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:30.196242 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:30.196245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:30.196712 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:30.196891 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:30.196900 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.198057 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.198062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:30.199109 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:30.199123 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.199810 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.199815 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:30.199940 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:30.200557 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:30.200574 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:30.203885 (+ 3311us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":325,"threads_started":1}
W20260808 08:41:30.204420 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:30.195165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:59421 (local address 127.19.242.254:32881)
0808 08:41:30.195347 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:30.195351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:30.195840 (+ 489us) server_negotiation.cc:407] Connection header received
0808 08:41:30.196001 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:30.196008 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:30.196096 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:30.196183 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:30.197082 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.197905 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.199254 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.199661 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.199765 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:30.204156 (+ 4391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:59421: BlockingRecv error: recv got EOF from 127.19.242.193:59421 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 08:41:30 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:30 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:30.255383 1195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:30.245331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:53623)
0808 08:41:30.245969 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:30.245988 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:30.246179 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:30.246619 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:30.246624 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:30.247102 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:30.247267 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:30.247278 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.248457 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.248465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:30.249612 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:30.249626 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.250484 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.250490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:30.250698 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:30.251476 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:30.251496 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:30.254991 (+ 3495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":374,"threads_started":1}
W20260808 08:41:30.255571 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:30.245440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:53623 (local address 127.19.242.254:32881)
0808 08:41:30.245783 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:30.245791 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:30.246163 (+ 372us) server_negotiation.cc:407] Connection header received
0808 08:41:30.246375 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:30.246379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:30.246451 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:30.246571 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:30.247469 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.248296 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.249794 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.250303 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.250474 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:30.255303 (+ 4829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:53623: BlockingRecv error: recv got EOF from 127.19.242.195:53623 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
Aug 08 08:41:30 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:30 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:30.722386 1196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:30.713685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:59459)
0808 08:41:30.714295 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:30.714313 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:30.714431 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:30.714800 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:30.714803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:30.715231 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:30.715403 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:30.715413 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.716438 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.716442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:30.717371 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:30.717383 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.718061 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.718066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:30.718198 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:30.718942 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:30.718961 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:30.722128 (+ 3167us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":319,"threads_started":1}
W20260808 08:41:30.722945 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:30.713871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:59459 (local address 127.19.242.254:32881)
0808 08:41:30.714081 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:30.714087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:30.714407 (+ 320us) server_negotiation.cc:407] Connection header received
0808 08:41:30.714519 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:30.714522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:30.714585 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:30.714667 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:30.715551 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.716314 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.717507 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:30.717929 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:30.718024 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:30.722389 (+ 4365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:59459: BlockingRecv error: recv got EOF from 127.19.242.194:59459 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 08 08:41:31 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:31 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:31.215276 1197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:31.205422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:60357)
0808 08:41:31.206166 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:31.206185 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:31.206324 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:31.206791 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:31.206796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:31.207251 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:31.207432 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:31.207441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.208517 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.208521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:31.209668 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:31.209681 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.210621 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.210626 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:31.210844 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:31.211654 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:31.211673 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:31.215034 (+ 3361us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":364,"threads_started":1}
W20260808 08:41:31.215695 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:31.205569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:60357 (local address 127.19.242.254:32881)
0808 08:41:31.205743 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:31.205748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:31.206298 (+ 550us) server_negotiation.cc:407] Connection header received
0808 08:41:31.206445 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:31.206449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:31.206522 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:31.206734 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:31.207596 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.208363 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.209811 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.210428 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.210543 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:31.215403 (+ 4860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:60357: BlockingRecv error: recv got EOF from 127.19.242.193:60357 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 08:41:31 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:31 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:31.266639 1198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:31.256758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:58773)
0808 08:41:31.257391 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:31.257411 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:31.257558 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:31.257923 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:31.257927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:31.258425 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:31.258652 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:31.258664 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.259874 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.259879 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:31.260928 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:31.260942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.261710 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.261715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:31.261862 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:31.262573 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:31.262594 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:31.266346 (+ 3752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":321,"threads_started":1}
W20260808 08:41:31.267021 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:31.256887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58773 (local address 127.19.242.254:32881)
0808 08:41:31.257137 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:31.257142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:31.257503 (+ 361us) server_negotiation.cc:407] Connection header received
0808 08:41:31.257680 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:31.257685 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:31.257753 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:31.257854 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:31.258869 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.259701 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.261089 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.261542 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.261655 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:31.266616 (+ 4961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:58773: BlockingRecv error: recv got EOF from 127.19.242.195:58773 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 08:41:31 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:31 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:31.739082 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:31.723681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:48583)
0808 08:41:31.724484 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:31.724506 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:31.724679 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:31.725181 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:31.725187 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:31.725647 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:31.725831 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:31.725842 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.727102 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.727107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:31.728147 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:31.728161 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.729020 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.729027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:31.729238 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:31.734685 (+ 5447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:31.734770 (+ 85us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:31.738818 (+ 4048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":499,"threads_started":1}
W20260808 08:41:31.739320 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:31.723729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:48583 (local address 127.19.242.254:32881)
0808 08:41:31.723920 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:31.723928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:31.724609 (+ 681us) server_negotiation.cc:407] Connection header received
0808 08:41:31.724840 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:31.724849 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:31.724956 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:31.725086 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:31.726003 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.726926 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.728315 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:31.728830 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:31.728990 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:31.739073 (+ 10083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:48583: BlockingRecv error: recv got EOF from 127.19.242.194:48583 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 08:41:32 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:32 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:32.226120 1202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:32.216375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:53259)
0808 08:41:32.217078 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:32.217095 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:32.217308 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:32.217700 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:32.217704 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:32.218182 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:32.218369 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:32.218379 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.219528 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.219534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:32.220480 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:32.220492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.221308 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.221315 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:32.221491 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:32.222176 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:32.222197 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:32.225723 (+ 3526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":324,"threads_started":1}
W20260808 08:41:32.226349 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:32.216517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:53259 (local address 127.19.242.254:32881)
0808 08:41:32.216785 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:32.216792 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:32.217201 (+ 409us) server_negotiation.cc:407] Connection header received
0808 08:41:32.217467 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:32.217471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:32.217543 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:32.217658 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:32.218538 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.219373 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.220649 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.221122 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.221272 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:32.226042 (+ 4770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:53259: BlockingRecv error: recv got EOF from 127.19.242.193:53259 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 08:41:32 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:32 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:32.277258 1205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:32.267779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:53451)
0808 08:41:32.268409 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:32.268436 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:32.268591 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:32.268985 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:32.268988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:32.269379 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:32.269532 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:32.269541 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.270661 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.270665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:32.271634 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:32.271649 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.272455 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.272460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:32.272593 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:32.273343 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:32.273362 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:32.276918 (+ 3556us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":351,"threads_started":1}
W20260808 08:41:32.277616 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:32.267873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:53451 (local address 127.19.242.254:32881)
0808 08:41:32.268096 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:32.268101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:32.268572 (+ 471us) server_negotiation.cc:407] Connection header received
0808 08:41:32.268720 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:32.268724 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:32.268792 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:32.268885 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:32.269694 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.270518 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.271809 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.272277 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.272383 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:32.277314 (+ 4931us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:53451: BlockingRecv error: recv got EOF from 127.19.242.195:53451 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 08 08:41:32 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:32 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:32.750267 1206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:32.740239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:54167)
0808 08:41:32.740900 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:32.740918 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:32.741097 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:32.741547 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:32.741552 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:32.742092 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:32.742278 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:32.742289 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.743567 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.743572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:32.744597 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:32.744610 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.745444 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.745450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:32.745641 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:32.746466 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:32.746486 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:32.749919 (+ 3433us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":298,"threads_started":1}
W20260808 08:41:32.750620 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:32.740318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:54167 (local address 127.19.242.254:32881)
0808 08:41:32.740578 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:32.740588 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:32.741019 (+ 431us) server_negotiation.cc:407] Connection header received
0808 08:41:32.741283 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:32.741287 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:32.741381 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:32.741507 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:32.742447 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.743391 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.744784 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:32.745258 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:32.745413 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:32.750185 (+ 4772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:54167: BlockingRecv error: recv got EOF from 127.19.242.194:54167 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 08 08:41:33 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:33 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:33.237316 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:33.227393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:32769)
0808 08:41:33.228079 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:33.228101 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:33.228285 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:33.228710 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:33.228744 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:33.229248 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:33.229488 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:33.229509 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.230671 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.230678 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:33.231630 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:33.231642 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.232508 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.232515 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:33.232683 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:33.233442 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:33.233461 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:33.237037 (+ 3576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":351,"threads_started":1}
W20260808 08:41:33.237574 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:33.227520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:32769 (local address 127.19.242.254:32881)
0808 08:41:33.227806 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:33.227813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:33.228260 (+ 447us) server_negotiation.cc:407] Connection header received
0808 08:41:33.228437 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:33.228443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:33.228528 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:33.228671 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:33.229655 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.230516 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.231811 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.232306 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.232461 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:33.237343 (+ 4882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:32769: BlockingRecv error: recv got EOF from 127.19.242.193:32769 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 08 08:41:33 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:33 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:33.287632 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:33.278496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:58757)
0808 08:41:33.279186 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:33.279204 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:33.279414 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:33.279804 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:33.279811 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:33.280273 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:33.280441 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:33.280450 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.281674 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.281681 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:33.282615 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:33.282627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.283428 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.283434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:33.283617 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:33.284272 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:33.284291 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:33.287255 (+ 2964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":374,"threads_started":1}
W20260808 08:41:33.287791 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:33.279152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58757 (local address 127.19.242.254:32881)
0808 08:41:33.279446 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:33.279454 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:33.279478 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:41:33.279539 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:33.279544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:33.279617 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:33.279729 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:33.280605 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.281518 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.282831 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.283265 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.283409 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:33.287500 (+ 4091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:58757: BlockingRecv error: recv got EOF from 127.19.242.195:58757 (error 108)
Metrics: {"server-negotiator.queue_time_us":131}
Aug 08 08:41:33 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:33 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:33.762001 1209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:33.751403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:50853)
0808 08:41:33.752150 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:33.752175 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:33.752366 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:33.752801 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:33.752806 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:33.753388 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:33.753629 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:33.753645 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.755125 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.755130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:33.756198 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:33.756213 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.757042 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.757048 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:33.757184 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:33.757982 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:33.758005 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:33.761540 (+ 3535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":381,"threads_started":1}
W20260808 08:41:33.762152 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:33.751553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:50853 (local address 127.19.242.254:32881)
0808 08:41:33.751854 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:33.751862 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:33.752308 (+ 446us) server_negotiation.cc:407] Connection header received
0808 08:41:33.752516 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:33.752522 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:33.752610 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:33.752709 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:33.753803 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.754932 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.756376 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:33.756822 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:33.756929 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:33.761911 (+ 4982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:50853: BlockingRecv error: recv got EOF from 127.19.242.194:50853 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
Aug 08 08:41:34 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:34 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:34.248776 1210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:34.238571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:50249)
0808 08:41:34.239326 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:34.239345 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:34.239548 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:34.240001 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:34.240006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:34.240557 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:34.240813 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:34.240825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.241998 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.242006 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:34.243100 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:34.243113 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.243962 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.243969 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:34.244171 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:34.244813 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:34.244834 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:34.248391 (+ 3557us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":442,"threads_started":1}
W20260808 08:41:34.248926 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:34.238791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:50249 (local address 127.19.242.254:32881)
0808 08:41:34.239217 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:34.239228 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:34.239462 (+ 234us) server_negotiation.cc:407] Connection header received
0808 08:41:34.239755 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:34.239759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:34.239833 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:34.239963 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:34.240983 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.241821 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.243274 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.243772 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.243934 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:34.248628 (+ 4694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:50249: BlockingRecv error: recv got EOF from 127.19.242.193:50249 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 08 08:41:34 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:34 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:34.298669 1212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:34.288882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:43935)
0808 08:41:34.289678 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:34.289697 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:34.289881 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:34.290270 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:34.290274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:34.290801 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:34.290984 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:34.291039 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.292391 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.292398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:34.293588 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:34.293602 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.294378 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.294385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:34.294562 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:34.295288 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:34.295308 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:34.298411 (+ 3103us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":390,"threads_started":1}
W20260808 08:41:34.299016 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:34.289025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:43935 (local address 127.19.242.254:32881)
0808 08:41:34.289335 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:34.289343 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:34.289800 (+ 457us) server_negotiation.cc:407] Connection header received
0808 08:41:34.290026 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:34.290032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:34.290115 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:34.290237 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:34.291209 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.292241 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.293748 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.294184 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.294327 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:34.298656 (+ 4329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:43935: BlockingRecv error: recv got EOF from 127.19.242.195:43935 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 08 08:41:34 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:34 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:34.772542 1214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:34.763354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:53195)
0808 08:41:34.763970 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:34.763987 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:34.764149 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:34.764589 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:34.764595 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:34.765037 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:34.765204 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:34.765213 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.766295 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.766302 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:34.767338 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:34.767351 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.768122 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.768128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:34.768311 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:34.769003 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:34.769022 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:34.772164 (+ 3142us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":335,"threads_started":1}
W20260808 08:41:34.772693 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:34.763508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:53195 (local address 127.19.242.254:32881)
0808 08:41:34.763746 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:34.763755 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:34.764074 (+ 319us) server_negotiation.cc:407] Connection header received
0808 08:41:34.764354 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:34.764360 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:34.764441 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:34.764550 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:34.765363 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.766138 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.767489 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:34.767946 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:34.768088 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:34.772404 (+ 4316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:53195: BlockingRecv error: recv got EOF from 127.19.242.194:53195 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 08 08:41:35 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:35 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:35.259588 1216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:35.249945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:55185)
0808 08:41:35.250539 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:35.250566 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:35.250779 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:35.251254 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:35.251264 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:35.251722 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:35.251887 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:35.251897 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.253094 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.253099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:35.254152 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:35.254166 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.255055 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.255060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:35.255247 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:35.255913 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:35.255943 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:35.259299 (+ 3356us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":382,"threads_started":1}
W20260808 08:41:35.259814 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:35.250066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:55185 (local address 127.19.242.254:32881)
0808 08:41:35.250309 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:35.250318 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:35.250683 (+ 365us) server_negotiation.cc:407] Connection header received
0808 08:41:35.250921 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:35.250927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:35.251035 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:35.251139 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:35.252056 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.252925 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.254351 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.254841 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.254983 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:35.259558 (+ 4575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:55185: BlockingRecv error: recv got EOF from 127.19.242.193:55185 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 08:41:35 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:35 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:35.310310 1217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:35.299950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:38377)
0808 08:41:35.300671 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:35.300690 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:35.300883 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:35.301369 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:35.301373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:35.301978 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:35.302325 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:35.302342 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.303623 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.303627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:35.304750 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:35.304765 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.305587 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.305593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:35.305741 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:35.306478 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:35.306499 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:35.310035 (+ 3536us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":426,"threads_started":1}
W20260808 08:41:35.310556 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:35.300090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:38377 (local address 127.19.242.254:32881)
0808 08:41:35.300338 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:35.300348 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:35.300796 (+ 448us) server_negotiation.cc:407] Connection header received
0808 08:41:35.301028 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:35.301034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:35.301182 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:35.301306 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:35.302514 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.303459 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.304924 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.305383 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.305491 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:35.310250 (+ 4759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:38377: BlockingRecv error: recv got EOF from 127.19.242.195:38377 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 08:41:35 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:35 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:35.782680 1218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:35.773790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:51539)
0808 08:41:35.774549 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:35.774565 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:35.774679 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:35.775096 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:35.775101 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:35.775511 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:35.775697 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:35.775712 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.776734 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.776739 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:35.777720 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:35.777732 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.778496 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.778502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:35.778691 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:35.779389 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:35.779408 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:35.782412 (+ 3004us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":515,"threads_started":1}
W20260808 08:41:35.782954 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:35.773892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:51539 (local address 127.19.242.254:32881)
0808 08:41:35.774101 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:35.774107 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:35.774654 (+ 547us) server_negotiation.cc:407] Connection header received
0808 08:41:35.774885 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:35.774890 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:35.774957 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:35.775065 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:35.775851 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.776587 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.777867 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:35.778321 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:35.778472 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:35.782644 (+ 4172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:51539: BlockingRecv error: recv got EOF from 127.19.242.194:51539 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 08:41:36 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:36 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:36.270884 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:36.260965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:47859)
0808 08:41:36.261712 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:36.261731 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:36.261878 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:36.262342 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:36.262345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:36.262904 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:36.263102 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:36.263112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.264327 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.264335 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:36.265338 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:36.265351 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.266216 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.266222 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:36.266433 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:36.267250 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:36.267270 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:36.270500 (+ 3230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":442,"threads_started":1}
W20260808 08:41:36.271183 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:36.261384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:47859 (local address 127.19.242.254:32881)
0808 08:41:36.261608 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:36.261613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:36.261861 (+ 248us) server_negotiation.cc:407] Connection header received
0808 08:41:36.261998 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:36.262002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:36.262165 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:36.262282 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:36.263313 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.264156 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.265508 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.266009 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.266192 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:36.270852 (+ 4660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:47859: BlockingRecv error: recv got EOF from 127.19.242.193:47859 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 08 08:41:36 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:36 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:36.321501 1223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:36.311476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:58861)
0808 08:41:36.312177 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:36.312195 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:36.312323 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:36.312817 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:36.312822 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:36.313314 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:36.313486 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:36.313497 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.314954 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.314960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:36.316194 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:36.316211 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.317008 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.317014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:36.317190 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:36.317900 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:36.317919 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:36.321248 (+ 3329us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":430,"threads_started":1}
W20260808 08:41:36.321817 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:36.311657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58861 (local address 127.19.242.254:32881)
0808 08:41:36.311858 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:36.311863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:36.312292 (+ 429us) server_negotiation.cc:407] Connection header received
0808 08:41:36.312490 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:36.312495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:36.312609 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:36.312709 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:36.313675 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.314728 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.316356 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.316820 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.316966 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:36.321495 (+ 4529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:58861: BlockingRecv error: recv got EOF from 127.19.242.195:58861 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 08:41:36 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:36 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:36.797796 1225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:36.783922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:60249)
0808 08:41:36.784500 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:36.784518 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:36.784646 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:36.784983 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:36.784986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:36.785417 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:36.785602 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:36.785611 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.786686 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.786690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:36.787803 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:36.787818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.788553 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.788558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:36.788689 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:36.794019 (+ 5330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:36.794042 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:36.797490 (+ 3448us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":321,"threads_started":1}
W20260808 08:41:36.797991 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:36.784052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:60249 (local address 127.19.242.254:32881)
0808 08:41:36.784273 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:36.784278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:36.784610 (+ 332us) server_negotiation.cc:407] Connection header received
0808 08:41:36.784766 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:36.784770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:36.784838 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:36.784933 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:36.785764 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.786539 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.787956 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:36.788400 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:36.788504 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:36.797749 (+ 9245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:60249: BlockingRecv error: recv got EOF from 127.19.242.194:60249 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 08:41:37 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:37 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:37.281500 1226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:37.272282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:34879)
0808 08:41:37.272926 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:37.272943 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:37.273062 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:37.273433 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:37.273437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:37.273878 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:37.274041 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:37.274051 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.275279 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.275284 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:37.276366 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:37.276389 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.277171 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.277176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:37.277318 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:37.278124 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:37.278144 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:37.281238 (+ 3094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":394,"threads_started":1}
W20260808 08:41:37.282018 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:37.272384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:34879 (local address 127.19.242.254:32881)
0808 08:41:37.272591 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:37.272599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:37.273031 (+ 432us) server_negotiation.cc:407] Connection header received
0808 08:41:37.273171 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:37.273175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:37.273285 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:37.273373 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:37.274256 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.275099 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.276553 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.277010 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.277133 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:37.281548 (+ 4415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:34879: BlockingRecv error: recv got EOF from 127.19.242.193:34879 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 08 08:41:37 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:37 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:37.331969 1227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:37.322650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:33981)
0808 08:41:37.323450 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:37.323471 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:37.323653 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:37.324057 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:37.324061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:37.324519 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:37.324773 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:37.324785 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.325831 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.325836 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:37.326891 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:37.326905 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.327745 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.327774 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:37.327963 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:37.328611 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:37.328629 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:37.331702 (+ 3073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":448,"threads_started":1}
W20260808 08:41:37.332312 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:37.322792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:33981 (local address 127.19.242.254:32881)
0808 08:41:37.323039 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:37.323048 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:37.323575 (+ 527us) server_negotiation.cc:407] Connection header received
0808 08:41:37.323798 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:37.323804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:37.323897 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:37.324012 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:37.324923 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.325677 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.327042 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.327537 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.327695 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:37.331979 (+ 4284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:33981: BlockingRecv error: recv got EOF from 127.19.242.195:33981 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 08:41:37 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:37 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:37.809427 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:37.799291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:42669)
0808 08:41:37.799945 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:37.799972 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:37.800110 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:37.800537 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:37.800543 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:37.801023 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:37.801203 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:37.801216 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.802375 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.802384 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:37.803504 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:37.803519 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.804365 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.804376 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:37.804591 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:37.805374 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:37.805395 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:37.809038 (+ 3643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":379,"threads_started":1}
W20260808 08:41:37.809803 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:37.799389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:42669 (local address 127.19.242.254:32881)
0808 08:41:37.799701 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:37.799709 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:37.800100 (+ 391us) server_negotiation.cc:407] Connection header received
0808 08:41:37.800222 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:37.800229 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:37.800336 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:37.800483 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:37.801386 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.802202 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.803680 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:37.804166 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:37.804317 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:37.809300 (+ 4983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:42669: BlockingRecv error: recv got EOF from 127.19.242.194:42669 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 08 08:41:38 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:38 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:38.292182 1229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:38.282624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:46393)
0808 08:41:38.283227 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:38.283246 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:38.283375 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:38.283772 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:38.283777 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:38.284251 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:38.284454 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:38.284465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.285566 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.285570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:38.286552 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:38.286566 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.287410 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.287415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:38.287565 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:38.288256 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:38.288277 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:38.291920 (+ 3643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":350,"threads_started":1}
W20260808 08:41:38.292390 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:38.282840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:46393 (local address 127.19.242.254:32881)
0808 08:41:38.283093 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:38.283100 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:38.283341 (+ 241us) server_negotiation.cc:407] Connection header received
0808 08:41:38.283492 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:38.283496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:38.283587 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:38.283675 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:38.284624 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.285377 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.286729 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.287218 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.287323 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:38.292127 (+ 4804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:46393: BlockingRecv error: recv got EOF from 127.19.242.193:46393 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 08 08:41:38 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:38 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:38.342887 1231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:38.333257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:41995)
0808 08:41:38.333958 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:38.333976 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:38.334106 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:38.334499 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:38.334503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:38.334970 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:38.335145 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:38.335155 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.336163 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.336167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:38.337136 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:38.337149 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.337830 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.337835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:38.337970 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:38.338610 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:38.338627 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:38.342521 (+ 3894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":438,"threads_started":1}
W20260808 08:41:38.343078 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:38.333281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:41995 (local address 127.19.242.254:32881)
0808 08:41:38.333573 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:38.333579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:38.334065 (+ 486us) server_negotiation.cc:407] Connection header received
0808 08:41:38.334248 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:38.334252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:38.334337 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:38.334423 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:38.335282 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.336006 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.337268 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.337692 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.337785 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:38.342822 (+ 5037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:41995: BlockingRecv error: recv got EOF from 127.19.242.195:41995 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 08 08:41:38 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:38 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:38.819550 1232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:38.810553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:48513)
0808 08:41:38.811184 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:38.811201 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:38.811332 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:38.811738 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:38.811746 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:38.812208 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:38.812446 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:38.812469 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.813841 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.813845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:38.814847 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:38.814862 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.815586 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.815591 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:38.815709 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:38.816381 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:38.816401 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:38.819310 (+ 2909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":335,"threads_started":1}
W20260808 08:41:38.819875 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:38.810773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:48513 (local address 127.19.242.254:32881)
0808 08:41:38.810966 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:38.810971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:38.811300 (+ 329us) server_negotiation.cc:407] Connection header received
0808 08:41:38.811458 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:38.811463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:38.811555 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:38.811659 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:38.812612 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.813694 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.814982 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:38.815418 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:38.815529 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:38.819537 (+ 4008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:48513: BlockingRecv error: recv got EOF from 127.19.242.194:48513 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 08:41:39 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:39 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:39.303725 1233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:39.293259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:55451)
0808 08:41:39.293871 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:39.293888 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:39.294010 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:39.294420 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:39.294424 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:39.294988 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:39.295214 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:39.295226 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.296510 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.296515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:39.297798 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:39.297813 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.298674 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.298679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:39.298851 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:39.299548 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:39.299570 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:39.303319 (+ 3749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":370,"threads_started":1}
W20260808 08:41:39.303893 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:39.293370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:55451 (local address 127.19.242.254:32881)
0808 08:41:39.293593 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:39.293606 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:39.293981 (+ 375us) server_negotiation.cc:407] Connection header received
0808 08:41:39.294120 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:39.294124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:39.294189 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:39.294325 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:39.295412 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.296297 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.297956 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.298487 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.298588 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:39.303574 (+ 4986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:55451: BlockingRecv error: recv got EOF from 127.19.242.193:55451 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 08:41:39 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:39 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:39.353926 1234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:39.343950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:55037)
0808 08:41:39.344525 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:39.344542 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:39.344670 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:39.345168 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:39.345172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:39.345608 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:39.345785 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:39.345795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.347241 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.347247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:39.348253 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:39.348270 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.349178 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.349184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:39.349312 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:39.350027 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:39.350058 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:39.353515 (+ 3457us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":326,"threads_started":1}
W20260808 08:41:39.354158 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:39.344053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:55037 (local address 127.19.242.254:32881)
0808 08:41:39.344430 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:39.344437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:39.344661 (+ 224us) server_negotiation.cc:407] Connection header received
0808 08:41:39.344865 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:39.344869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:39.344957 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:39.345052 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:39.345971 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.347004 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.348447 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.348917 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.349027 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:39.353786 (+ 4759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:55037: BlockingRecv error: recv got EOF from 127.19.242.195:55037 (error 108)
Metrics: {"server-negotiator.queue_time_us":209}
Aug 08 08:41:39 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:39 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:39.830593 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:39.820643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:46603)
0808 08:41:39.821157 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:39.821175 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:39.821302 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:39.821673 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:39.821677 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:39.822122 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:39.822329 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:39.822340 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.823510 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.823515 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:39.824553 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:39.824568 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.825451 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.825456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:39.825582 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:39.826340 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:39.826363 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:39.830319 (+ 3956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":268,"threads_started":1}
W20260808 08:41:39.830925 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:39.820728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:46603 (local address 127.19.242.254:32881)
0808 08:41:39.820988 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:39.820995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:39.821262 (+ 267us) server_negotiation.cc:407] Connection header received
0808 08:41:39.821407 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:39.821411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:39.821476 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:39.821570 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:39.822495 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.823343 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.824726 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:39.825295 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:39.825404 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:39.830588 (+ 5184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:46603: BlockingRecv error: recv got EOF from 127.19.242.194:46603 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 08:41:40 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:40 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.193@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:40.315337 1238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:40.305460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.193:42013)
0808 08:41:40.306068 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:40.306085 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:40.306277 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:40.306786 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:40.306791 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:40.307411 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:40.307645 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:40.307661 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.308848 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.308853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:40.310042 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:40.310057 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.310922 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.310927 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:40.311055 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:40.311754 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:40.311774 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:40.315062 (+ 3288us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":329,"threads_started":1}
W20260808 08:41:40.315702 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:40.305521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:42013 (local address 127.19.242.254:32881)
0808 08:41:40.305829 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:40.305839 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:40.306210 (+ 371us) server_negotiation.cc:407] Connection header received
0808 08:41:40.306463 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:40.306471 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:40.306558 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:40.306690 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:40.307814 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.308659 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.310261 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.310764 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.310885 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:40.315405 (+ 4520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.193:42013: BlockingRecv error: recv got EOF from 127.19.242.193:42013 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 08:41:40 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:40 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.195@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:40.364894 1239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:40.355421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.195:58197)
0808 08:41:40.355966 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:40.355983 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:40.356167 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:40.356593 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:40.356597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:40.357032 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:40.357217 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:40.357228 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.358801 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.358807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:40.359754 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:40.359786 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.360611 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.360615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:40.360756 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:40.361476 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:40.361495 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:40.364492 (+ 2997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":304,"threads_started":1}
W20260808 08:41:40.365060 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:40.355528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:58197 (local address 127.19.242.254:32881)
0808 08:41:40.355783 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:40.355792 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:40.356090 (+ 298us) server_negotiation.cc:407] Connection header received
0808 08:41:40.356319 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:40.356326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:40.356437 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:40.356555 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:40.357408 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.358543 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.359942 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.360455 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.360593 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:40.364814 (+ 4221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.195:58197: BlockingRecv error: recv got EOF from 127.19.242.195:58197 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 08 08:41:40 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:41:40 dist-test-slave-39l8 krb5kdc[32175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.242.194@KRBTEST.COM for oryx/127.19.242.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:41:40.845949 1241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:40.832091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:32881 (local address 127.19.242.194:41877)
0808 08:41:40.832802 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:40.832827 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:40.832940 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:40.833281 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:40.833284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:40.833693 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:40.833965 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:40.833976 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.835124 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.835128 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:40.836073 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:40.836086 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.836827 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.836832 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:40.836947 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:40.842166 (+ 5219us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:40.842189 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:40.845654 (+ 3465us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.242.254:32881: Server oryx/127.19.242.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":411,"threads_started":1}
W20260808 08:41:40.846112 785 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:40.832161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:41877 (local address 127.19.242.254:32881)
0808 08:41:40.832325 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:40.832330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:40.832913 (+ 583us) server_negotiation.cc:407] Connection header received
0808 08:41:40.833041 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:40.833045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:40.833111 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:40.833197 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:40.834110 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.834981 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.836214 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:40.836665 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:40.836768 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:40.845879 (+ 9111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.242.194:41877: BlockingRecv error: recv got EOF from 127.19.242.194:41877 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:41:41.179834 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 559
I20260808 08:41:41.194819 1244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:41.181200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33114 (local address 127.19.242.193:35275)
0808 08:41:41.181959 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:41.181967 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:41.181999 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:41:41.182071 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:41.182078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:41.182328 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:41.182525 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:41.184242 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:41.185419 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:41.186770 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:41.187469 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:41.187603 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:41.190397 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:41.190408 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:41.190425 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:41.190493 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:41.193809 (+ 3316us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.242.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:41:41.194326 (+ 517us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33114: Request ticket server kudu/127.19.242.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":412,"threads_started":1}
W20260808 08:41:41.194778 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 559: Not authorized: Client connection negotiation failed: client connection to 127.19.242.193:35275: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.242.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:41:41.194947 1244 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33114: Request ticket server kudu/127.19.242.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:41:41.195096 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 559
I20260808 08:41:41.224407 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 789
I20260808 08:41:41.238519 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:41.225555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33410 (local address 127.19.242.194:45567)
0808 08:41:41.226291 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:41.226299 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:41.226335 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:41:41.226411 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:41.226418 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:41.226644 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:41.226937 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:41.228403 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:41.229519 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:41.230956 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:41.231580 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:41.231745 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:41.234693 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:41.234759 (+ 66us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:41.234781 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:41.234839 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:41.237694 (+ 2855us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.242.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:41:41.238102 (+ 408us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33410: Request ticket server kudu/127.19.242.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":325,"threads_started":1}
W20260808 08:41:41.238677 1245 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33410: Request ticket server kudu/127.19.242.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:41:41.238778 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 789: Not authorized: Client connection negotiation failed: client connection to 127.19.242.194:45567: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.242.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:41:41.238977 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 789
I20260808 08:41:41.268836 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 977
I20260808 08:41:41.282132 1246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:41.269894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36404 (local address 127.19.242.195:46651)
0808 08:41:41.270604 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:41.270612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:41.270640 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:41:41.270810 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:41.270818 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:41.271056 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:41.271230 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:41.272710 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:41.273736 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:41.275102 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:41.275699 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:41.275817 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:41.278596 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:41.278605 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:41.278621 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:41.278684 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:41.281559 (+ 2875us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.242.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:41:41.281865 (+ 306us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36404: Request ticket server kudu/127.19.242.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":384,"threads_started":1}
W20260808 08:41:41.282274 1246 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36404: Request ticket server kudu/127.19.242.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:41:41.282428 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 977: Not authorized: Client connection negotiation failed: client connection to 127.19.242.195:46651: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.19.242.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:41:41.282686 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 977
I20260808 08:41:41.312117 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 462
I20260808 08:41:41.313544 551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:41.432859 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 462
2026-08-08T08:41:41Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22327 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T08:41:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:41Z Disabled control of system clock
I20260808 08:41:41.540452 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36147
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:34619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36147
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:41:41.914443 1252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:41.914815 1252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:41.914901 1252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:41.922384 1252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:41.922570 1252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:41.922617 1252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:41.922684 1252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:41.922752 1252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:41.932523 1252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36147
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:41.934064 1252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:41.936074 1252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:41.949479 1259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:41.949462 1260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:41.950261 1265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:41.951586 1252 server_base.cc:1034] running on GCE node
I20260808 08:41:41.952605 1252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:41.954496 1252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:41.955806 1252 hybrid_clock.cc:648] HybridClock initialized: now 1786178501955748 us; error 80 us; skew 500 ppm
I20260808 08:41:41.956312 1252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:41.963511 1252 webserver.cc:460] Webserver started at http://127.19.242.254:38793/ using document root <none> and password file <none>
I20260808 08:41:41.964368 1252 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:41.964529 1252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:41.964902 1252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:41.968197 1252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "efa259081fd2494ea1f831930e7105c1"
format_stamp: "Formatted at 2026-08-08 08:41:41 on dist-test-slave-39l8"
server_key: "a44c40cb7912bdb9e7a8d136d16168f8"
server_key_iv: "45045e42ab1b0c97b80c56b16af010c3"
server_key_version: "encryptionkey@0"
I20260808 08:41:41.969199 1252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "efa259081fd2494ea1f831930e7105c1"
format_stamp: "Formatted at 2026-08-08 08:41:41 on dist-test-slave-39l8"
server_key: "a44c40cb7912bdb9e7a8d136d16168f8"
server_key_iv: "45045e42ab1b0c97b80c56b16af010c3"
server_key_version: "encryptionkey@0"
I20260808 08:41:41.976209 1252 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260808 08:41:41.980577 1275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:41.982362 1252 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 08:41:41.982643 1252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "efa259081fd2494ea1f831930e7105c1"
format_stamp: "Formatted at 2026-08-08 08:41:41 on dist-test-slave-39l8"
server_key: "a44c40cb7912bdb9e7a8d136d16168f8"
server_key_iv: "45045e42ab1b0c97b80c56b16af010c3"
server_key_version: "encryptionkey@0"
I20260808 08:41:41.983019 1252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:42.003554 1252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:42.004719 1252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:42.005086 1252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:42.031152 1252 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36147
I20260808 08:41:42.031162 1349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36147 every 8 connection(s)
I20260808 08:41:42.032902 1252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:41:42.035275 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 1252
I20260808 08:41:42.035502 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:41:42.036262 20427 external_mini_cluster.cc:1428] Setting key 8e666ae153389793cd82fb1cfb4b42d2
I20260808 08:41:42.037582 1350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:42.052899 1350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1: Bootstrap starting.
I20260808 08:41:42.053532 1354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:42.038601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36514 (local address 127.19.242.254:36147)
0808 08:41:42.039832 (+ 1231us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:42.039855 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:42.039905 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:41:42.042590 (+ 2685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:42.042621 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:42.043320 (+ 699us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:42.043751 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:42.044592 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:42.046182 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:42.048288 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:42.049072 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:42.049283 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:42.050812 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:42.050822 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:42.050843 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:42.051504 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:42.051600 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:42.051625 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:42.051725 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:42.052011 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 08:41:42.052429 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":434,"threads_started":1}
I20260808 08:41:42.056878 1350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:42.058019 1350 log.cc:824] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:42.061216 1350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1: No bootstrap required, opened a new log
I20260808 08:41:42.069339 1350 raft_consensus.cc:348] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efa259081fd2494ea1f831930e7105c1" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36147 } }
I20260808 08:41:42.069896 1350 raft_consensus.cc:374] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:42.070041 1350 raft_consensus.cc:729] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efa259081fd2494ea1f831930e7105c1, State: Initialized, Role: FOLLOWER
I20260808 08:41:42.070649 1350 consensus_queue.cc:260] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efa259081fd2494ea1f831930e7105c1" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36147 } }
I20260808 08:41:42.070981 1350 raft_consensus.cc:388] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:41:42.071096 1350 raft_consensus.cc:482] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:41:42.071239 1350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:42.073519 1350 raft_consensus.cc:504] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efa259081fd2494ea1f831930e7105c1" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36147 } }
I20260808 08:41:42.074039 1350 leader_election.cc:302] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efa259081fd2494ea1f831930e7105c1; no voters:
I20260808 08:41:42.074687 1350 leader_election.cc:288] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:41:42.074991 1358 raft_consensus.cc:2781] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:42.075945 1358 raft_consensus.cc:686] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [term 1 LEADER]: Becoming Leader. State: Replica: efa259081fd2494ea1f831930e7105c1, State: Running, Role: LEADER
I20260808 08:41:42.076658 1358 consensus_queue.cc:237] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efa259081fd2494ea1f831930e7105c1" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36147 } }
I20260808 08:41:42.077167 1350 sys_catalog.cc:564] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:42.081374 1360 sys_catalog.cc:455] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader efa259081fd2494ea1f831930e7105c1. Latest consensus state: current_term: 1 leader_uuid: "efa259081fd2494ea1f831930e7105c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efa259081fd2494ea1f831930e7105c1" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36147 } } }
I20260808 08:41:42.081483 1359 sys_catalog.cc:455] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efa259081fd2494ea1f831930e7105c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efa259081fd2494ea1f831930e7105c1" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36147 } } }
I20260808 08:41:42.081925 1360 sys_catalog.cc:458] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:42.081972 1359 sys_catalog.cc:458] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:42.088177 1372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:42.094827 1372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:42.105722 1372 catalog_manager.cc:1347] Generated new cluster ID: 84087ffda99d48cb9aa2ff4ceef82e3d
I20260808 08:41:42.105877 1372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:42.136581 1372 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:41:42.138195 1372 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:42.146174 1372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P efa259081fd2494ea1f831930e7105c1: Generated new TSK 0
I20260808 08:41:42.147282 1372 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:41:42.160552 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36147
--builtin_ntp_servers=127.19.242.212:34619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 08:41:42.550962 1387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:42.551324 1387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:42.551479 1387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:42.560398 1387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:42.560535 1387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:42.560717 1387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:42.571694 1387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:42.573167 1387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:42.575242 1387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:42.590780 1397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:42.590670 1395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:42.590816 1394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:42.591954 1387 server_base.cc:1034] running on GCE node
I20260808 08:41:42.592751 1387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:42.593897 1387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:42.595182 1387 hybrid_clock.cc:648] HybridClock initialized: now 1786178502595126 us; error 83 us; skew 500 ppm
I20260808 08:41:42.595597 1387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:42.598237 1387 webserver.cc:460] Webserver started at http://127.19.242.193:44527/ using document root <none> and password file <none>
I20260808 08:41:42.599154 1387 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:42.599308 1387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:42.599691 1387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:42.602991 1387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "44dde65c44064cb99b569ff8224fe5f1"
format_stamp: "Formatted at 2026-08-08 08:41:42 on dist-test-slave-39l8"
server_key: "2be16f56f098c7212b93d40fbfe2e014"
server_key_iv: "88a0f5c7e0a862738e0ee5ffd004f5f2"
server_key_version: "encryptionkey@0"
I20260808 08:41:42.603948 1387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "44dde65c44064cb99b569ff8224fe5f1"
format_stamp: "Formatted at 2026-08-08 08:41:42 on dist-test-slave-39l8"
server_key: "2be16f56f098c7212b93d40fbfe2e014"
server_key_iv: "88a0f5c7e0a862738e0ee5ffd004f5f2"
server_key_version: "encryptionkey@0"
I20260808 08:41:42.609973 1387 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:41:42.614297 1405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:42.615990 1387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:42.616235 1387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "44dde65c44064cb99b569ff8224fe5f1"
format_stamp: "Formatted at 2026-08-08 08:41:42 on dist-test-slave-39l8"
server_key: "2be16f56f098c7212b93d40fbfe2e014"
server_key_iv: "88a0f5c7e0a862738e0ee5ffd004f5f2"
server_key_version: "encryptionkey@0"
I20260808 08:41:42.616505 1387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:42.638064 1387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:42.639104 1387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:42.639459 1387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:42.640581 1387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:42.642271 1387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:42.642412 1387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:42.642561 1387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:42.642654 1387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:42.680456 1387 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:36517
I20260808 08:41:42.680516 1568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:36517 every 8 connection(s)
I20260808 08:41:42.681974 1387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:42.686933 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 1387
I20260808 08:41:42.687178 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:41:42.688212 20427 external_mini_cluster.cc:1428] Setting key 01cb457cdab2ed0b01b9fe2595c8ca3e
I20260808 08:41:42.691707 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36147
--builtin_ntp_servers=127.19.242.212:34619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:41:42.699019 1573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:42.685223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:33133 (local address 127.19.242.254:36147)
0808 08:41:42.685720 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:42.685727 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:42.687491 (+ 1764us) server_negotiation.cc:407] Connection header received
0808 08:41:42.689742 (+ 2251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:42.689747 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:42.689851 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:42.689982 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:42.691640 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:42.692564 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:42.695452 (+ 2888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:42.695887 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:42.696005 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:42.697985 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:42.697990 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:42.697994 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:42.698059 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:42.698107 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:42.698122 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:42.698204 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:42.698543 (+ 339us) server_negotiation.cc:299] Negotiation successful
0808 08:41:42.698640 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":231,"threads_started":1}
I20260808 08:41:42.700608 1574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:42.685975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36147 (local address 127.19.242.193:33133)
0808 08:41:42.687282 (+ 1307us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:42.687335 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:42.689435 (+ 2100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:42.690255 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:42.690264 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:42.690406 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:42.691390 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:42.691423 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:42.692766 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:42.692776 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:42.695208 (+ 2432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:42.695233 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:42.696172 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:42.696183 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:42.696558 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:42.697507 (+ 949us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:41:42.697512 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:42.697579 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:41:42.697712 (+ 133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:42.698237 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:42.698251 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:42.698262 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:41:42.698471 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 08:41:42.698998 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":402,"threads_started":1}
I20260808 08:41:42.702423 1570 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36147
I20260808 08:41:42.702841 1570 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:42.703677 1570 heartbeater.cc:511] Master 127.19.242.254:36147 requested a full tablet report, sending...
I20260808 08:41:42.706353 1301 ts_manager.cc:194] Registered new tserver with Master: 44dde65c44064cb99b569ff8224fe5f1 (127.19.242.193:36517)
I20260808 08:41:42.708037 1301 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.193:33133
W20260808 08:41:43.062064 1575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:43.062407 1575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:43.062561 1575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:43.070228 1575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:43.070358 1575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:43.070547 1575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:43.080785 1575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:43.082248 1575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:43.084386 1575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:43.099475 1584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:43.099520 1587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:43.099561 1585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:43.100703 1575 server_base.cc:1034] running on GCE node
I20260808 08:41:43.101432 1575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:43.102541 1575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:43.103835 1575 hybrid_clock.cc:648] HybridClock initialized: now 1786178503103745 us; error 81 us; skew 500 ppm
I20260808 08:41:43.104250 1575 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:43.107044 1575 webserver.cc:460] Webserver started at http://127.19.242.194:40937/ using document root <none> and password file <none>
I20260808 08:41:43.107865 1575 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:43.108013 1575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:43.108392 1575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:43.111683 1575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "233e62d02e7d42ba8906039d4aac544b"
format_stamp: "Formatted at 2026-08-08 08:41:43 on dist-test-slave-39l8"
server_key: "b6f1300e15a7ddc79a3a924df526f0a8"
server_key_iv: "ed8356e6fcd6b66fff29f38f80097b97"
server_key_version: "encryptionkey@0"
I20260808 08:41:43.112629 1575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "233e62d02e7d42ba8906039d4aac544b"
format_stamp: "Formatted at 2026-08-08 08:41:43 on dist-test-slave-39l8"
server_key: "b6f1300e15a7ddc79a3a924df526f0a8"
server_key_iv: "ed8356e6fcd6b66fff29f38f80097b97"
server_key_version: "encryptionkey@0"
I20260808 08:41:43.119524 1575 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:41:43.123989 1595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:43.125936 1575 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:41:43.126204 1575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "233e62d02e7d42ba8906039d4aac544b"
format_stamp: "Formatted at 2026-08-08 08:41:43 on dist-test-slave-39l8"
server_key: "b6f1300e15a7ddc79a3a924df526f0a8"
server_key_iv: "ed8356e6fcd6b66fff29f38f80097b97"
server_key_version: "encryptionkey@0"
I20260808 08:41:43.126497 1575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:43.140588 1575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:43.141600 1575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:43.141965 1575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:43.143219 1575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:43.144945 1575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:43.145079 1575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:43.145226 1575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:43.145323 1575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:43.182533 1575 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45163
I20260808 08:41:43.182592 1748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45163 every 8 connection(s)
I20260808 08:41:43.184094 1575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:43.188093 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 1575
I20260808 08:41:43.188308 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:41:43.188984 20427 external_mini_cluster.cc:1428] Setting key 9cdb1a243f8df7edb010b867df0cda82
I20260808 08:41:43.192196 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36147
--builtin_ntp_servers=127.19.242.212:34619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:41:43.201367 1573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:43.187056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:44133 (local address 127.19.242.254:36147)
0808 08:41:43.187338 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:43.187347 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:43.189748 (+ 2401us) server_negotiation.cc:407] Connection header received
0808 08:41:43.192163 (+ 2415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:43.192171 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:43.192275 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:43.192425 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:43.194314 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.195242 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.197953 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.198391 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.198510 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:43.200508 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:43.200513 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:43.200516 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:43.200539 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:43.200576 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:43.200589 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:43.200679 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:43.201006 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 08:41:43.201102 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:41:43.203136 1753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:43.188090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36147 (local address 127.19.242.194:44133)
0808 08:41:43.189490 (+ 1400us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:43.189584 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:43.191815 (+ 2231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:43.192930 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:43.192947 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:43.193101 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:43.194065 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:43.194099 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.195437 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.195445 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:43.197726 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:43.197761 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.198671 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.198681 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:43.199115 (+ 434us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:43.200025 (+ 910us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:41:43.200031 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:43.200106 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:41:43.200236 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:43.200715 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:43.200730 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:43.200750 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 08:41:43.200977 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 08:41:43.201504 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":466,"threads_started":1}
I20260808 08:41:43.205061 1750 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36147
I20260808 08:41:43.205564 1750 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:43.206794 1750 heartbeater.cc:511] Master 127.19.242.254:36147 requested a full tablet report, sending...
I20260808 08:41:43.208747 1301 ts_manager.cc:194] Registered new tserver with Master: 233e62d02e7d42ba8906039d4aac544b (127.19.242.194:45163)
I20260808 08:41:43.210177 1301 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.194:44133
W20260808 08:41:43.580504 1755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:43.580840 1755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:43.580996 1755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:43.590018 1755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:43.590147 1755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:43.590364 1755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:43.600853 1755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36147
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:43.602756 1755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:43.604910 1755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:43.619797 1766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:43.619937 1765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:43.619933 1768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:43.620776 1755 server_base.cc:1034] running on GCE node
I20260808 08:41:43.621608 1755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:43.622761 1755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:43.624023 1755 hybrid_clock.cc:648] HybridClock initialized: now 1786178503623943 us; error 77 us; skew 500 ppm
I20260808 08:41:43.624408 1755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:43.627029 1755 webserver.cc:460] Webserver started at http://127.19.242.195:45931/ using document root <none> and password file <none>
I20260808 08:41:43.627811 1755 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:43.627956 1755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:43.628320 1755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:43.631568 1755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "48f0d95d007e4c85a0159309e8c62565"
format_stamp: "Formatted at 2026-08-08 08:41:43 on dist-test-slave-39l8"
server_key: "24d779757043eaa343fa635987627a86"
server_key_iv: "1125729a28248b493ac7b04b23d1f987"
server_key_version: "encryptionkey@0"
I20260808 08:41:43.632532 1755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "48f0d95d007e4c85a0159309e8c62565"
format_stamp: "Formatted at 2026-08-08 08:41:43 on dist-test-slave-39l8"
server_key: "24d779757043eaa343fa635987627a86"
server_key_iv: "1125729a28248b493ac7b04b23d1f987"
server_key_version: "encryptionkey@0"
I20260808 08:41:43.638406 1755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:41:43.642392 1776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:43.644016 1755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:43.644245 1755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "48f0d95d007e4c85a0159309e8c62565"
format_stamp: "Formatted at 2026-08-08 08:41:43 on dist-test-slave-39l8"
server_key: "24d779757043eaa343fa635987627a86"
server_key_iv: "1125729a28248b493ac7b04b23d1f987"
server_key_version: "encryptionkey@0"
I20260808 08:41:43.644503 1755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:43.666393 1755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:43.667433 1755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:43.667785 1755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:43.668861 1755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:43.670547 1755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:43.670680 1755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:43.670856 1755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:43.670956 1755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:43.709512 1755 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:45949
I20260808 08:41:43.709607 1938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:45949 every 8 connection(s)
I20260808 08:41:43.711074 1755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:43.712594 1570 heartbeater.cc:503] Master 127.19.242.254:36147 was elected leader, sending a full tablet report...
I20260808 08:41:43.720889 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 1755
I20260808 08:41:43.721102 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:41:43.721642 20427 external_mini_cluster.cc:1428] Setting key 0efd535f5a69c08969d04973ad4850ac
I20260808 08:41:43.725706 1942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:43.714470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:44093 (local address 127.19.242.254:36147)
0808 08:41:43.715052 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:43.715060 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:43.716339 (+ 1279us) server_negotiation.cc:407] Connection header received
0808 08:41:43.718217 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:43.718225 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:43.718338 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:43.718465 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:43.719683 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.720566 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.722675 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.723166 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.723305 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:43.724810 (+ 1505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:43.724814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:43.724818 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:43.724834 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:43.724902 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:43.724920 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:43.725023 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:43.725307 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 08:41:43.725393 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":332,"threads_started":1}
I20260808 08:41:43.726878 1943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:43.715129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36147 (local address 127.19.242.195:44093)
0808 08:41:43.716148 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:43.716200 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:43.717919 (+ 1719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:43.718762 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:43.718774 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:43.718880 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:43.719501 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:43.719519 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.720730 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.720736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:43.722522 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:43.722537 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.723420 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.723429 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:43.723683 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:43.724457 (+ 774us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:41:43.724459 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:43.724502 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:41:43.724602 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:43.725059 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:43.725076 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:43.725083 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:41:43.725270 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 08:41:43.725602 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":312,"threads_started":1}
I20260808 08:41:43.728322 1939 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36147
I20260808 08:41:43.728648 1939 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:43.729465 1939 heartbeater.cc:511] Master 127.19.242.254:36147 requested a full tablet report, sending...
I20260808 08:41:43.731103 1301 ts_manager.cc:194] Registered new tserver with Master: 48f0d95d007e4c85a0159309e8c62565 (127.19.242.195:45949)
I20260808 08:41:43.731950 1301 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.195:44093
I20260808 08:41:43.737509 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:41:43.744046 1942 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:43.742310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36528 (local address 127.19.242.254:36147)
0808 08:41:43.742569 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:43.742577 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:43.742897 (+ 320us) server_negotiation.cc:407] Connection header received
0808 08:41:43.743113 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:43.743118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:43.743188 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:43.743284 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:43.743832 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36528: BlockingRecv error: recv got EOF from 127.0.0.1:36528 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 08:41:43.745620 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 1387
I20260808 08:41:43.754318 1951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:43.746685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50538 (local address 127.19.242.193:36517)
0808 08:41:43.747370 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:43.747377 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:43.747406 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:41:43.747469 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:43.747476 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:43.747692 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:43.747833 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:43.748324 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.749396 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.750761 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.751360 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.751466 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:43.752699 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:43.752708 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:43.752724 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:43.753375 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:43.753428 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:43.753457 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:43.753558 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:43.753776 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 08:41:43.753954 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":344,"threads_started":1}
I20260808 08:41:43.755795 1562 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:43.842810 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 1387
I20260808 08:41:43.868331 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 1575
I20260808 08:41:43.877066 1953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:43.869332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45706 (local address 127.19.242.194:45163)
0808 08:41:43.869962 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:43.869969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:43.870000 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:41:43.870067 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:43.870073 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:43.870306 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:43.870449 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:43.870963 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.872045 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.873336 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.874065 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.874178 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:43.875427 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:43.875436 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:43.875452 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:43.876108 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:43.876159 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:43.876180 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:43.876295 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:43.876463 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 08:41:43.876640 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":325,"threads_started":1}
I20260808 08:41:43.878465 1743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:43.961741 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 1575
I20260808 08:41:43.990679 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 1755
I20260808 08:41:43.999800 1955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:43.991906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37758 (local address 127.19.242.195:45949)
0808 08:41:43.992565 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:43.992572 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:43.992616 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:41:43.992680 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:43.992687 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:43.992943 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:43.993078 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:43.993588 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.994766 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.996161 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:43.996807 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:43.996917 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:43.998189 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:43.998199 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:43.998215 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:43.998948 (+ 733us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:43.999003 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:43.999025 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:43.999123 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:43.999318 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 08:41:43.999444 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":348,"threads_started":1}
I20260808 08:41:44.001242 1933 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:44.088094 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 1755
I20260808 08:41:44.113840 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 1252
I20260808 08:41:44.115262 1344 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:44.222010 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 1252
2026-08-08T08:41:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2782 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T08:41:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:44Z Disabled control of system clock
I20260808 08:41:44.320640 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44091
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:33463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:44091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:41:44.690196 1962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:44.690538 1962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:44.690634 1962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:44.698352 1962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:44.698559 1962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:44.698645 1962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:44.698778 1962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:44.698851 1962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:44.709394 1962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:44091
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:44.710805 1962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:44.712916 1962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:44.726188 1969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:44.726271 1967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:44.726213 1973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:44.727505 1962 server_base.cc:1034] running on GCE node
I20260808 08:41:44.728389 1962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:44.729926 1962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:44.731220 1962 hybrid_clock.cc:648] HybridClock initialized: now 1786178504731172 us; error 67 us; skew 500 ppm
I20260808 08:41:44.731637 1962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:44.734125 1962 webserver.cc:460] Webserver started at http://127.19.242.254:44369/ using document root <none> and password file <none>
I20260808 08:41:44.735046 1962 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:44.735291 1962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:44.735850 1962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:44.739284 1962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "053934a75b09434f97d7113693650128"
format_stamp: "Formatted at 2026-08-08 08:41:44 on dist-test-slave-39l8"
server_key: "fd686dd371efda1fd99aefa060bd4e4d"
server_key_iv: "67ddbbf3739543f6e714ada4f0a81361"
server_key_version: "encryptionkey@0"
I20260808 08:41:44.740213 1962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "053934a75b09434f97d7113693650128"
format_stamp: "Formatted at 2026-08-08 08:41:44 on dist-test-slave-39l8"
server_key: "fd686dd371efda1fd99aefa060bd4e4d"
server_key_iv: "67ddbbf3739543f6e714ada4f0a81361"
server_key_version: "encryptionkey@0"
I20260808 08:41:44.746001 1962 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260808 08:41:44.750118 1980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:44.751773 1962 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:44.752012 1962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "053934a75b09434f97d7113693650128"
format_stamp: "Formatted at 2026-08-08 08:41:44 on dist-test-slave-39l8"
server_key: "fd686dd371efda1fd99aefa060bd4e4d"
server_key_iv: "67ddbbf3739543f6e714ada4f0a81361"
server_key_version: "encryptionkey@0"
I20260808 08:41:44.752285 1962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:44.758915 1962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:44.759862 1962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:44.760215 1962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:44.780686 1962 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:44091
I20260808 08:41:44.780730 2067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:44091 every 8 connection(s)
I20260808 08:41:44.782258 1962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:41:44.783047 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 1962
I20260808 08:41:44.783394 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:41:44.784217 20427 external_mini_cluster.cc:1428] Setting key d74247f95bc5f035f3b0c58a4a976467
I20260808 08:41:44.787566 2068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:44.794919 2075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:44.786548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40708 (local address 127.19.242.254:44091)
0808 08:41:44.787806 (+ 1258us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:44.787822 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:44.787889 (+ 67us) server_negotiation.cc:407] Connection header received
0808 08:41:44.790248 (+ 2359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:44.790278 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:44.790903 (+ 625us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:44.791412 (+ 509us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:44.792586 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:44.792595 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:44.792622 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:44.792643 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:44.792746 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:44.792774 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:44.793039 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:44.793185 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 08:41:44.793501 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":441,"threads_started":1}
I20260808 08:41:44.801594 2068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128: Bootstrap starting.
I20260808 08:41:44.804793 2068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:44.805927 2068 log.cc:824] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:44.809623 2068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128: No bootstrap required, opened a new log
I20260808 08:41:44.817951 2068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053934a75b09434f97d7113693650128" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44091 } }
I20260808 08:41:44.818372 2068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:44.818462 2068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 053934a75b09434f97d7113693650128, State: Initialized, Role: FOLLOWER
I20260808 08:41:44.819207 2068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053934a75b09434f97d7113693650128" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44091 } }
I20260808 08:41:44.819561 2068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:41:44.819741 2068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:41:44.819953 2068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:44.822271 2068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053934a75b09434f97d7113693650128" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44091 } }
I20260808 08:41:44.822811 2068 leader_election.cc:302] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 053934a75b09434f97d7113693650128; no voters:
I20260808 08:41:44.823423 2068 leader_election.cc:288] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:41:44.823577 2078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:44.825569 2078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [term 1 LEADER]: Becoming Leader. State: Replica: 053934a75b09434f97d7113693650128, State: Running, Role: LEADER
I20260808 08:41:44.825666 2068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:44.826130 2078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053934a75b09434f97d7113693650128" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44091 } }
I20260808 08:41:44.829190 2079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "053934a75b09434f97d7113693650128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053934a75b09434f97d7113693650128" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44091 } } }
I20260808 08:41:44.829759 2079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:44.830667 2080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 053934a75b09434f97d7113693650128. Latest consensus state: current_term: 1 leader_uuid: "053934a75b09434f97d7113693650128" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053934a75b09434f97d7113693650128" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44091 } } }
I20260808 08:41:44.832981 2080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128 [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:44.834142 2094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:44.839350 2094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:44.848568 2094 catalog_manager.cc:1347] Generated new cluster ID: a3a6f355097b4b71ba7e5cda4546d239
I20260808 08:41:44.848745 2094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:44.862414 2094 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:41:44.862998 2094 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:44.872344 2094 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 053934a75b09434f97d7113693650128: Generated new TSK 0
I20260808 08:41:44.873284 2094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:41:44.880451 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44091
--builtin_ntp_servers=127.19.242.212:33463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:41:45.251149 2104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:45.251477 2104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:45.251647 2104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:45.260032 2104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:45.260164 2104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:45.260366 2104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:45.269896 2104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:45.271360 2104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:45.273291 2104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:45.287496 2111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:45.287467 2117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:45.287425 2114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:45.288926 2104 server_base.cc:1034] running on GCE node
I20260808 08:41:45.289645 2104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:45.290863 2104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:45.292172 2104 hybrid_clock.cc:648] HybridClock initialized: now 1786178505292122 us; error 52 us; skew 500 ppm
I20260808 08:41:45.292573 2104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:45.295241 2104 webserver.cc:460] Webserver started at http://127.19.242.193:40037/ using document root <none> and password file <none>
I20260808 08:41:45.296022 2104 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:45.296175 2104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:45.296515 2104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:45.299750 2104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "a4f5d3c95f5844bf9ad966bd6c4116c0"
format_stamp: "Formatted at 2026-08-08 08:41:45 on dist-test-slave-39l8"
server_key: "154e0b9a43f97f4a08c13a0b5f185be7"
server_key_iv: "59618c5fe0622d75efc8c5b18b12cee5"
server_key_version: "encryptionkey@0"
I20260808 08:41:45.300670 2104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "a4f5d3c95f5844bf9ad966bd6c4116c0"
format_stamp: "Formatted at 2026-08-08 08:41:45 on dist-test-slave-39l8"
server_key: "154e0b9a43f97f4a08c13a0b5f185be7"
server_key_iv: "59618c5fe0622d75efc8c5b18b12cee5"
server_key_version: "encryptionkey@0"
I20260808 08:41:45.306576 2104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 08:41:45.310503 2125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:45.312181 2104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:45.312404 2104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "a4f5d3c95f5844bf9ad966bd6c4116c0"
format_stamp: "Formatted at 2026-08-08 08:41:45 on dist-test-slave-39l8"
server_key: "154e0b9a43f97f4a08c13a0b5f185be7"
server_key_iv: "59618c5fe0622d75efc8c5b18b12cee5"
server_key_version: "encryptionkey@0"
I20260808 08:41:45.312661 2104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:45.318984 2104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:45.319906 2104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:45.320251 2104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:45.321386 2104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:45.323060 2104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:45.323189 2104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:45.323331 2104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:45.323421 2104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:45.361340 2104 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:45479
I20260808 08:41:45.361438 2314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:45479 every 8 connection(s)
I20260808 08:41:45.362859 2104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:45.364567 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 2104
I20260808 08:41:45.364810 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:41:45.365461 20427 external_mini_cluster.cc:1428] Setting key 3f6421b069d3556022eb1021753271cd
I20260808 08:41:45.368913 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44091
--builtin_ntp_servers=127.19.242.212:33463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 08:41:45.372609 2319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:45.365870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:45867 (local address 127.19.242.254:44091)
0808 08:41:45.366815 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:45.366821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:45.367941 (+ 1120us) server_negotiation.cc:407] Connection header received
0808 08:41:45.369801 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:45.369810 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:45.369887 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:45.370020 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:45.371626 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:45.371635 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:45.371643 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:45.371669 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:45.371751 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:45.371774 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:45.371920 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:45.372144 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 08:41:45.372216 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":790,"thread_start_us":676,"threads_started":1}
I20260808 08:41:45.373659 2320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:45.366494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44091 (local address 127.19.242.193:45867)
0808 08:41:45.367740 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:45.367803 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:45.369511 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:45.370191 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:45.370199 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:45.370302 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:45.371292 (+ 990us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:41:45.371295 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:45.371335 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:41:45.371433 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:45.371898 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:45.371907 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:45.371914 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:41:45.372201 (+ 287us) client_negotiation.cc:240] Negotiation successful
0808 08:41:45.372493 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":338,"threads_started":1}
I20260808 08:41:45.375752 2315 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44091
I20260808 08:41:45.376116 2315 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:45.376892 2315 heartbeater.cc:511] Master 127.19.242.254:44091 requested a full tablet report, sending...
I20260808 08:41:45.379317 2015 ts_manager.cc:194] Registered new tserver with Master: a4f5d3c95f5844bf9ad966bd6c4116c0 (127.19.242.193:45479)
W20260808 08:41:45.730559 2324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:45.730950 2324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:45.731101 2324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:45.738875 2324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:45.738998 2324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:45.739180 2324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:45.749048 2324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:45.750460 2324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:45.752503 2324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:45.767181 2332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:45.767273 2333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:45.767273 2335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:45.768283 2324 server_base.cc:1034] running on GCE node
I20260808 08:41:45.769085 2324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:45.770215 2324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:45.771478 2324 hybrid_clock.cc:648] HybridClock initialized: now 1786178505771429 us; error 55 us; skew 500 ppm
I20260808 08:41:45.771888 2324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:45.774607 2324 webserver.cc:460] Webserver started at http://127.19.242.194:43469/ using document root <none> and password file <none>
I20260808 08:41:45.775528 2324 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:45.775717 2324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:45.776181 2324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:45.781010 2324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "144fd6b56e61422abd1adedc3d7109c1"
format_stamp: "Formatted at 2026-08-08 08:41:45 on dist-test-slave-39l8"
server_key: "5cce0b4b956450adb8274dd4fccc66f1"
server_key_iv: "13f29864780290506ec391b24733943f"
server_key_version: "encryptionkey@0"
I20260808 08:41:45.782254 2324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "144fd6b56e61422abd1adedc3d7109c1"
format_stamp: "Formatted at 2026-08-08 08:41:45 on dist-test-slave-39l8"
server_key: "5cce0b4b956450adb8274dd4fccc66f1"
server_key_iv: "13f29864780290506ec391b24733943f"
server_key_version: "encryptionkey@0"
I20260808 08:41:45.790540 2324 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.000s
I20260808 08:41:45.794787 2342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:45.796414 2324 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:41:45.796625 2324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "144fd6b56e61422abd1adedc3d7109c1"
format_stamp: "Formatted at 2026-08-08 08:41:45 on dist-test-slave-39l8"
server_key: "5cce0b4b956450adb8274dd4fccc66f1"
server_key_iv: "13f29864780290506ec391b24733943f"
server_key_version: "encryptionkey@0"
I20260808 08:41:45.796876 2324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:45.803253 2324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:45.804158 2324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:45.804471 2324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:45.805470 2324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:45.807106 2324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:45.807255 2324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:45.807389 2324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:45.807478 2324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:45.844810 2324 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:42211
I20260808 08:41:45.844880 2520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:42211 every 8 connection(s)
I20260808 08:41:45.846398 2324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:45.853092 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 2324
I20260808 08:41:45.853335 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:41:45.853991 20427 external_mini_cluster.cc:1428] Setting key 76e42161bf4e7a87920d67fed6e64cdb
I20260808 08:41:45.857013 2319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:45.849549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:51641 (local address 127.19.242.254:44091)
0808 08:41:45.849816 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:45.849823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:45.851530 (+ 1707us) server_negotiation.cc:407] Connection header received
0808 08:41:45.853952 (+ 2422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:45.853957 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:45.854021 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:45.854162 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:45.855991 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:45.855997 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:45.856001 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:45.856065 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:45.856104 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:45.856118 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:45.856291 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:45.856595 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 08:41:45.856669 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 08:41:45.857940 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44091
--builtin_ntp_servers=127.19.242.212:33463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 08:41:45.858269 2524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:45.850133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44091 (local address 127.19.242.194:51641)
0808 08:41:45.851329 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:45.851386 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:45.853561 (+ 2175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:45.854442 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:45.854451 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:45.854557 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:45.855558 (+ 1001us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:41:45.855562 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:45.855620 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:41:45.855751 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:45.856304 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:45.856319 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:45.856328 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:41:45.856664 (+ 336us) client_negotiation.cc:240] Negotiation successful
0808 08:41:45.856962 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":364,"threads_started":1}
I20260808 08:41:45.860169 2521 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44091
I20260808 08:41:45.860561 2521 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:45.861264 2521 heartbeater.cc:511] Master 127.19.242.254:44091 requested a full tablet report, sending...
I20260808 08:41:45.862977 2015 ts_manager.cc:194] Registered new tserver with Master: 144fd6b56e61422abd1adedc3d7109c1 (127.19.242.194:42211)
W20260808 08:41:46.232933 2525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:46.233294 2525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:46.233403 2525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:46.241641 2525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:46.241786 2525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:46.241904 2525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:46.251895 2525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44091
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:46.253319 2525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:46.255254 2525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:46.270179 2533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:46.270198 2534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:46.270365 2536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:46.271199 2525 server_base.cc:1034] running on GCE node
I20260808 08:41:46.271914 2525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:46.273030 2525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:46.274288 2525 hybrid_clock.cc:648] HybridClock initialized: now 1786178506274214 us; error 75 us; skew 500 ppm
I20260808 08:41:46.274683 2525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:41:46.277415 2525 webserver.cc:460] Webserver started at http://127.19.242.195:35207/ using document root <none> and password file <none>
I20260808 08:41:46.278214 2525 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:46.278363 2525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:46.278803 2525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:46.281939 2525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "9a76647b61594ea383c8a4a4a6121d8c"
format_stamp: "Formatted at 2026-08-08 08:41:46 on dist-test-slave-39l8"
server_key: "4b706a30e21cba617650ba489f71e629"
server_key_iv: "92ec9c8a330a547eb21ded4d99eb9e89"
server_key_version: "encryptionkey@0"
I20260808 08:41:46.282883 2525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "9a76647b61594ea383c8a4a4a6121d8c"
format_stamp: "Formatted at 2026-08-08 08:41:46 on dist-test-slave-39l8"
server_key: "4b706a30e21cba617650ba489f71e629"
server_key_iv: "92ec9c8a330a547eb21ded4d99eb9e89"
server_key_version: "encryptionkey@0"
I20260808 08:41:46.288584 2525 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:41:46.292531 2542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:46.294198 2525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:41:46.294404 2525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "9a76647b61594ea383c8a4a4a6121d8c"
format_stamp: "Formatted at 2026-08-08 08:41:46 on dist-test-slave-39l8"
server_key: "4b706a30e21cba617650ba489f71e629"
server_key_iv: "92ec9c8a330a547eb21ded4d99eb9e89"
server_key_version: "encryptionkey@0"
I20260808 08:41:46.294688 2525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:46.301065 2525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:46.302033 2525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:46.302336 2525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:46.303413 2525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:46.304944 2525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:46.305076 2525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:46.305214 2525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:46.305311 2525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:46.341629 2525 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:43611
I20260808 08:41:46.341693 2720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:43611 every 8 connection(s)
I20260808 08:41:46.343262 2525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:46.352783 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 2525
I20260808 08:41:46.353049 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:41:46.353034 2319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:46.346378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:44891 (local address 127.19.242.254:44091)
0808 08:41:46.346600 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:46.346605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:46.348212 (+ 1607us) server_negotiation.cc:407] Connection header received
0808 08:41:46.350175 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:46.350182 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:46.350278 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:46.350406 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:46.352047 (+ 1641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:46.352053 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:46.352056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:46.352077 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:46.352115 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:46.352129 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:46.352376 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:46.352611 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 08:41:46.352697 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:41:46.353595 20427 external_mini_cluster.cc:1428] Setting key 615a401ac836904b5c7a9062b55bcc03
I20260808 08:41:46.354359 2728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:46.346927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44091 (local address 127.19.242.195:44891)
0808 08:41:46.348006 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:46.348047 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:46.349821 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:46.350687 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:46.350696 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:46.350872 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:46.351642 (+ 770us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:41:46.351645 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:46.351690 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:41:46.351800 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:46.352336 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:46.352349 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:46.352358 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:41:46.352739 (+ 381us) client_negotiation.cc:240] Negotiation successful
0808 08:41:46.353083 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":327,"threads_started":1}
I20260808 08:41:46.356071 2721 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44091
I20260808 08:41:46.356451 2721 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:46.357293 2721 heartbeater.cc:511] Master 127.19.242.254:44091 requested a full tablet report, sending...
I20260808 08:41:46.358937 2015 ts_manager.cc:194] Registered new tserver with Master: 9a76647b61594ea383c8a4a4a6121d8c (127.19.242.195:43611)
I20260808 08:41:46.370679 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:41:46.377404 2319 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:41:46.375791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40710 (local address 127.19.242.254:44091)
0808 08:41:46.376074 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:46.376082 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:46.376407 (+ 325us) server_negotiation.cc:407] Connection header received
0808 08:41:46.376595 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:46.376600 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:46.376660 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:46.376755 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:46.377133 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40710: BlockingRecv error: recv got EOF from 127.0.0.1:40710 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 08:41:46.378400 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 2104
I20260808 08:41:46.382603 2315 heartbeater.cc:503] Master 127.19.242.254:44091 was elected leader, sending a full tablet report...
I20260808 08:41:46.383142 2737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:46.379742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34138 (local address 127.19.242.193:45479)
0808 08:41:46.380412 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:46.380419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:46.380448 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:41:46.380511 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:46.380518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:46.380745 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:46.380892 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:46.381960 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:46.381969 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:46.381983 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:46.382001 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:46.382066 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:46.382083 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:46.382251 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:46.382416 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 08:41:46.382508 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":333,"threads_started":1}
I20260808 08:41:46.384562 2309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:46.470837 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 2104
I20260808 08:41:46.492710 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 2324
I20260808 08:41:46.496554 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:46.493846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40740 (local address 127.19.242.194:42211)
0808 08:41:46.494390 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:46.494397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:46.494425 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:41:46.494491 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:46.494497 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:46.494825 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:46.494962 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:46.495916 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:46.495922 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:46.495934 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:46.495951 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:46.495989 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:46.496003 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:46.496119 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:46.496203 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 08:41:46.496289 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":265,"threads_started":1}
I20260808 08:41:46.497885 2516 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:46.585049 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 2324
I20260808 08:41:46.611045 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 2525
I20260808 08:41:46.615764 2741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:46.612082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59554 (local address 127.19.242.195:43611)
0808 08:41:46.612816 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:46.612824 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:46.612859 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:41:46.612929 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:46.612936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:46.613162 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:46.613319 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:46.614694 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:46.614701 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:46.614879 (+ 178us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:41:46.614906 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:46.614955 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:41:46.614975 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:46.615123 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:46.615265 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 08:41:46.615394 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":369,"threads_started":1}
I20260808 08:41:46.617115 2715 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:46.700932 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 2525
I20260808 08:41:46.729008 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 1962
I20260808 08:41:46.730418 2061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:46.836398 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 1962
2026-08-08T08:41:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2613 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:41:46 dist-test-slave-39l8 krb5kdc[2746](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:41:46 dist-test-slave-39l8 krb5kdc[2746](info): set up 2 sockets
Aug 08 08:41:46 dist-test-slave-39l8 krb5kdc[2746](info): commencing operation
krb5kdc: starting...
W20260808 08:41:48.180258 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:41:48 dist-test-slave-39l8 krb5kdc[2746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:41:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:41:48.519356 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36887
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36887
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:48.889678 2764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:48.890019 2764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:48.890113 2764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:48.897769 2764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:41:48.897904 2764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:48.897953 2764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:48.898002 2764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:41:48.898048 2764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:41:48.908540 2764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:48.909972 2764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:48.911362 2764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:48.927278 2770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:48.930832 2774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:48.931473 2771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:48.932881 2764 server_base.cc:1034] running on GCE node
I20260808 08:41:48.934037 2764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:48.935967 2764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:48.937260 2764 hybrid_clock.cc:648] HybridClock initialized: now 1786178508937214 us; error 38 us; skew 500 ppm
I20260808 08:41:48.937716 2764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:48 dist-test-slave-39l8 krb5kdc[2746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178508, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:48.947144 2764 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:41:48.949095 2764 webserver.cc:460] Webserver started at http://127.19.242.254:45651/ using document root <none> and password file <none>
I20260808 08:41:48.949966 2764 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:48.950148 2764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:48.950508 2764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:48.953962 2764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "b84ad580e2bf46648a68143343e2d11f"
format_stamp: "Formatted at 2026-08-08 08:41:48 on dist-test-slave-39l8"
server_key: "251722e30b7d46d19ca6fe34f02f5860"
server_key_iv: "5fa423171e91ffd3040128923226e971"
server_key_version: "encryptionkey@0"
I20260808 08:41:48.954909 2764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "b84ad580e2bf46648a68143343e2d11f"
format_stamp: "Formatted at 2026-08-08 08:41:48 on dist-test-slave-39l8"
server_key: "251722e30b7d46d19ca6fe34f02f5860"
server_key_iv: "5fa423171e91ffd3040128923226e971"
server_key_version: "encryptionkey@0"
I20260808 08:41:48.960925 2764 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:41:48.964934 2785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:48.966444 2764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:41:48.966665 2764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "b84ad580e2bf46648a68143343e2d11f"
format_stamp: "Formatted at 2026-08-08 08:41:48 on dist-test-slave-39l8"
server_key: "251722e30b7d46d19ca6fe34f02f5860"
server_key_iv: "5fa423171e91ffd3040128923226e971"
server_key_version: "encryptionkey@0"
I20260808 08:41:48.966939 2764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:48.982682 2764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:48.987705 2764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:48.988039 2764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:49.008895 2764 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36887
I20260808 08:41:49.008934 2851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36887 every 8 connection(s)
I20260808 08:41:49.010381 2764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:41:49.014276 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 2764
I20260808 08:41:49.014545 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:41:49.014551 2852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:49.015268 20427 external_mini_cluster.cc:1428] Setting key 0f3d08c921576cfbb68cd41eda05724a
I20260808 08:41:49.029354 2852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f: Bootstrap starting.
Aug 08 08:41:49 dist-test-slave-39l8 krb5kdc[2746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:49.033428 2852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:49.034623 2852 log.cc:824] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:49.038326 2852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f: No bootstrap required, opened a new log
I20260808 08:41:49.041615 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:49.017354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45150 (local address 127.19.242.254:36887)
0808 08:41:49.018238 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:49.018251 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:49.018294 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:41:49.020768 (+ 2474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:49.020795 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:49.021237 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:49.021604 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:49.023671 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:49.025007 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:49.026976 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:49.027733 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:49.027885 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:49.032975 (+ 5090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:49.032985 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:49.033003 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:49.033054 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:49.036818 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:49.037727 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:49.037737 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:49.037745 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:49.037990 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:49.038487 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:49.038495 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:49.038502 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:49.039196 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:49.039562 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:49.040024 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 08:41:49.040515 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":428,"threads_started":1}
I20260808 08:41:49.047063 2852 raft_consensus.cc:348] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84ad580e2bf46648a68143343e2d11f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36887 } }
I20260808 08:41:49.047616 2852 raft_consensus.cc:374] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:49.047766 2852 raft_consensus.cc:729] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b84ad580e2bf46648a68143343e2d11f, State: Initialized, Role: FOLLOWER
I20260808 08:41:49.048519 2852 consensus_queue.cc:260] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84ad580e2bf46648a68143343e2d11f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36887 } }
I20260808 08:41:49.048779 2852 raft_consensus.cc:388] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:41:49.048882 2852 raft_consensus.cc:482] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:41:49.049010 2852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:49.051332 2852 raft_consensus.cc:504] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84ad580e2bf46648a68143343e2d11f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36887 } }
I20260808 08:41:49.051862 2852 leader_election.cc:302] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b84ad580e2bf46648a68143343e2d11f; no voters:
I20260808 08:41:49.052472 2852 leader_election.cc:288] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:41:49.052639 2861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:49.053352 2861 raft_consensus.cc:686] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [term 1 LEADER]: Becoming Leader. State: Replica: b84ad580e2bf46648a68143343e2d11f, State: Running, Role: LEADER
I20260808 08:41:49.053923 2861 consensus_queue.cc:237] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84ad580e2bf46648a68143343e2d11f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36887 } }
I20260808 08:41:49.054812 2852 sys_catalog.cc:564] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:41:49.056985 2862 sys_catalog.cc:455] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b84ad580e2bf46648a68143343e2d11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84ad580e2bf46648a68143343e2d11f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36887 } } }
I20260808 08:41:49.056912 2863 sys_catalog.cc:455] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b84ad580e2bf46648a68143343e2d11f. Latest consensus state: current_term: 1 leader_uuid: "b84ad580e2bf46648a68143343e2d11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b84ad580e2bf46648a68143343e2d11f" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36887 } } }
I20260808 08:41:49.057415 2863 sys_catalog.cc:458] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:49.057411 2862 sys_catalog.cc:458] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f [sys.catalog]: This master's current role is: LEADER
I20260808 08:41:49.058480 2869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:41:49.064380 2869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:41:49.080996 2869 catalog_manager.cc:1347] Generated new cluster ID: 0c8722eaf63d449b9097e525d8afc5a6
I20260808 08:41:49.081132 2869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:41:49.092574 2869 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:41:49.094776 2869 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:41:49.105006 2869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f: Generated new TSK 0
I20260808 08:41:49.106268 2869 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:41:49.186547 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36887
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:49.562557 2891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:49.563004 2891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:49.563185 2891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:49.571111 2891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:49.571260 2891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:49.571488 2891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:41:49.581961 2891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:49.583460 2891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:49.584888 2891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:49.599617 2897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:49.599530 2898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:49.599576 2901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:49.600659 2891 server_base.cc:1034] running on GCE node
I20260808 08:41:49.601313 2891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:49.602301 2891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:49.603564 2891 hybrid_clock.cc:648] HybridClock initialized: now 1786178509603495 us; error 66 us; skew 500 ppm
I20260808 08:41:49.603931 2891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:49 dist-test-slave-39l8 krb5kdc[2746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178509, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:49.607631 2891 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:41:49.609360 2891 webserver.cc:460] Webserver started at http://127.19.242.193:38753/ using document root <none> and password file <none>
I20260808 08:41:49.610146 2891 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:49.610293 2891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:49.610637 2891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:49.613950 2891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "c9f4cd92bb444cc48f9cb8ef28036af4"
format_stamp: "Formatted at 2026-08-08 08:41:49 on dist-test-slave-39l8"
server_key: "1639ef0c848f97e5985e3e7499a2c06f"
server_key_iv: "7b00b3f17e80d0381575f4060940a5e1"
server_key_version: "encryptionkey@0"
I20260808 08:41:49.614943 2891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "c9f4cd92bb444cc48f9cb8ef28036af4"
format_stamp: "Formatted at 2026-08-08 08:41:49 on dist-test-slave-39l8"
server_key: "1639ef0c848f97e5985e3e7499a2c06f"
server_key_iv: "7b00b3f17e80d0381575f4060940a5e1"
server_key_version: "encryptionkey@0"
I20260808 08:41:49.621170 2891 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:41:49.625265 2911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:49.626919 2891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:41:49.627125 2891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "c9f4cd92bb444cc48f9cb8ef28036af4"
format_stamp: "Formatted at 2026-08-08 08:41:49 on dist-test-slave-39l8"
server_key: "1639ef0c848f97e5985e3e7499a2c06f"
server_key_iv: "7b00b3f17e80d0381575f4060940a5e1"
server_key_version: "encryptionkey@0"
I20260808 08:41:49.627354 2891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:49.662045 2891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:49.666667 2891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:49.667096 2891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:49.668218 2891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:49.669795 2891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:49.669873 2891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:49.670008 2891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:49.670071 2891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:49.706576 2891 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:45327
I20260808 08:41:49.706629 3068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:45327 every 8 connection(s)
I20260808 08:41:49.708025 2891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:41:49.710570 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 2891
I20260808 08:41:49.710862 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:41:49.711643 20427 external_mini_cluster.cc:1428] Setting key 3c13c526aea5bdcfb274145eb388ea45
Aug 08 08:41:49 dist-test-slave-39l8 krb5kdc[2746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178509, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:49.734825 3075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:49.711172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:59551 (local address 127.19.242.254:36887)
0808 08:41:49.711780 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:49.711789 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:49.713149 (+ 1360us) server_negotiation.cc:407] Connection header received
0808 08:41:49.715837 (+ 2688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:49.715843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:49.715918 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:49.716027 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:49.718445 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:49.719288 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:49.721924 (+ 2636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:49.722339 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:49.722450 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:49.727468 (+ 5018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:49.727474 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:49.727477 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:49.727515 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:49.731111 (+ 3596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:49.731940 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:49.731949 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:49.731955 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:49.732126 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:49.732653 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:49.732661 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:49.732667 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:49.733072 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:49.733233 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:49.734000 (+ 767us) server_negotiation.cc:299] Negotiation successful
0808 08:41:49.734297 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":297,"threads_started":1}
I20260808 08:41:49.735507 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:49.712037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36887 (local address 127.19.242.193:59551)
0808 08:41:49.712990 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:49.713032 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:49.715461 (+ 2429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:49.716360 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:49.716378 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:49.717292 (+ 914us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:49.718203 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:49.718260 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:49.719468 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:49.719476 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:49.721735 (+ 2259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:49.721754 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:49.722604 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:49.722616 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:49.723010 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:49.723862 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:49.723904 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:49.727157 (+ 3253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:49.731290 (+ 4133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:49.731298 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:49.731314 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:49.731808 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:49.732288 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:49.732292 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:49.732294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:49.732505 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:49.733203 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:49.733210 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:49.733574 (+ 364us) client_negotiation.cc:769] Sending connection context
0808 08:41:49.733826 (+ 252us) client_negotiation.cc:240] Negotiation successful
0808 08:41:49.734261 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":387,"threads_started":1}
I20260808 08:41:49.737218 3072 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36887
I20260808 08:41:49.737593 3072 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:49.738570 3072 heartbeater.cc:511] Master 127.19.242.254:36887 requested a full tablet report, sending...
I20260808 08:41:49.741338 2808 ts_manager.cc:194] Registered new tserver with Master: c9f4cd92bb444cc48f9cb8ef28036af4 (127.19.242.193:45327)
I20260808 08:41:49.743335 2808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:59551
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:41:49.786404 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36887
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:50.166998 3080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:50.167402 3080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:50.167594 3080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:41:50.175534 3080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:50.175722 3080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:50.175917 3080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:41:50.186553 3080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:50.188241 3080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:50.189711 3080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:50.204092 3089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:50.203994 3094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:50.204049 3090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:50.205688 3080 server_base.cc:1034] running on GCE node
I20260808 08:41:50.206449 3080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:50.207674 3080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:50.208930 3080 hybrid_clock.cc:648] HybridClock initialized: now 1786178510208863 us; error 69 us; skew 500 ppm
I20260808 08:41:50.209290 3080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:50 dist-test-slave-39l8 krb5kdc[2746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178510, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:50.212806 3080 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:41:50.214387 3080 webserver.cc:460] Webserver started at http://127.19.242.194:37403/ using document root <none> and password file <none>
I20260808 08:41:50.215296 3080 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:50.215462 3080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:50.215796 3080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:50.219034 3080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "1b96cb6f5ce34002a09744914c3b8c47"
format_stamp: "Formatted at 2026-08-08 08:41:50 on dist-test-slave-39l8"
server_key: "0f22b2c2447378944daf014f3fd98a71"
server_key_iv: "ae75f645ae02ee4f73d43a9b5d973168"
server_key_version: "encryptionkey@0"
I20260808 08:41:50.219935 3080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "1b96cb6f5ce34002a09744914c3b8c47"
format_stamp: "Formatted at 2026-08-08 08:41:50 on dist-test-slave-39l8"
server_key: "0f22b2c2447378944daf014f3fd98a71"
server_key_iv: "ae75f645ae02ee4f73d43a9b5d973168"
server_key_version: "encryptionkey@0"
I20260808 08:41:50.225776 3080 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:41:50.229900 3101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:50.231745 3080 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:41:50.231972 3080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "1b96cb6f5ce34002a09744914c3b8c47"
format_stamp: "Formatted at 2026-08-08 08:41:50 on dist-test-slave-39l8"
server_key: "0f22b2c2447378944daf014f3fd98a71"
server_key_iv: "ae75f645ae02ee4f73d43a9b5d973168"
server_key_version: "encryptionkey@0"
I20260808 08:41:50.232231 3080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:50.247992 3080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:50.252789 3080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:50.253172 3080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:50.254267 3080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:50.255961 3080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:50.256078 3080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:50.256250 3080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:50.256330 3080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:50.293529 3080 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:33273
I20260808 08:41:50.293560 3277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:33273 every 8 connection(s)
I20260808 08:41:50.294991 3080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:41:50.300920 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 3080
I20260808 08:41:50.301148 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:41:50.301698 20427 external_mini_cluster.cc:1428] Setting key 250898e86e5952be67852b6515f3a05b
Aug 08 08:41:50 dist-test-slave-39l8 krb5kdc[2746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178510, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:50.319193 3280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.297830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:54197 (local address 127.19.242.254:36887)
0808 08:41:50.298338 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:50.298343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:50.299483 (+ 1140us) server_negotiation.cc:407] Connection header received
0808 08:41:50.301883 (+ 2400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:50.301888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:50.301966 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:50.302072 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:50.304142 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.304891 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.307611 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.308037 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.308144 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.312842 (+ 4698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:50.312848 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:50.312851 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:50.312889 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:50.315735 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:50.316608 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:50.316613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:50.316615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:50.316768 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:50.317262 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:50.317267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:50.317273 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:50.317553 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:50.317729 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:50.318503 (+ 774us) server_negotiation.cc:299] Negotiation successful
0808 08:41:50.318808 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":244,"threads_started":1}
I20260808 08:41:50.320302 3281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.298444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36887 (local address 127.19.242.194:54197)
0808 08:41:50.299302 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:50.299344 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:50.301497 (+ 2153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:50.302397 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:50.302407 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:50.303159 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:50.303950 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.303979 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.305074 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.305083 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.307421 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.307448 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.308293 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.308304 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.308649 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.309510 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:50.309549 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:50.312526 (+ 2977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:50.315919 (+ 3393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:50.315930 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:50.315952 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:50.316450 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:50.316896 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:50.316904 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:50.316907 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:50.317127 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:50.317695 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:50.317704 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:50.318089 (+ 385us) client_negotiation.cc:769] Sending connection context
0808 08:41:50.318390 (+ 301us) client_negotiation.cc:240] Negotiation successful
0808 08:41:50.319018 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":364,"threads_started":1}
I20260808 08:41:50.322075 3278 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36887
I20260808 08:41:50.322453 3278 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:50.323333 3278 heartbeater.cc:511] Master 127.19.242.254:36887 requested a full tablet report, sending...
I20260808 08:41:50.324981 2808 ts_manager.cc:194] Registered new tserver with Master: 1b96cb6f5ce34002a09744914c3b8c47 (127.19.242.194:33273)
I20260808 08:41:50.325855 2808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:54197
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:41:50.373687 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36887
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:41:50.746071 3286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:41:50.746399 3286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:41:50.746502 3286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 08:41:50.747552 3072 heartbeater.cc:503] Master 127.19.242.254:36887 was elected leader, sending a full tablet report...
W20260808 08:41:50.755210 3286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:41:50.755347 3286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:41:50.755528 3286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:41:50.766237 3286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:41:50.767797 3286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:41:50.769253 3286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:41:50.784323 3298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:50.784258 3294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:41:50.784651 3293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:41:50.785197 3286 server_base.cc:1034] running on GCE node
I20260808 08:41:50.785920 3286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:41:50.787065 3286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:41:50.788318 3286 hybrid_clock.cc:648] HybridClock initialized: now 1786178510788275 us; error 42 us; skew 500 ppm
I20260808 08:41:50.788671 3286 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:41:50 dist-test-slave-39l8 krb5kdc[2746](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178510, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:41:50.792958 3286 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:41:50.796582 3286 webserver.cc:460] Webserver started at http://127.19.242.195:36205/ using document root <none> and password file <none>
I20260808 08:41:50.797674 3286 fs_manager.cc:359] Metadata directory not provided
I20260808 08:41:50.797856 3286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:41:50.798280 3286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:41:50.803738 3286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "c729147c27294a24b4170cb8dde7a18a"
format_stamp: "Formatted at 2026-08-08 08:41:50 on dist-test-slave-39l8"
server_key: "6f30b5777703b4d6b4bf10ace66a643c"
server_key_iv: "e1f5bdf699ab871f92011197af5b7519"
server_key_version: "encryptionkey@0"
I20260808 08:41:50.805100 3286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "c729147c27294a24b4170cb8dde7a18a"
format_stamp: "Formatted at 2026-08-08 08:41:50 on dist-test-slave-39l8"
server_key: "6f30b5777703b4d6b4bf10ace66a643c"
server_key_iv: "e1f5bdf699ab871f92011197af5b7519"
server_key_version: "encryptionkey@0"
I20260808 08:41:50.811247 3286 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 08:41:50.815367 3309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:50.816992 3286 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:41:50.817166 3286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "c729147c27294a24b4170cb8dde7a18a"
format_stamp: "Formatted at 2026-08-08 08:41:50 on dist-test-slave-39l8"
server_key: "6f30b5777703b4d6b4bf10ace66a643c"
server_key_iv: "e1f5bdf699ab871f92011197af5b7519"
server_key_version: "encryptionkey@0"
I20260808 08:41:50.817418 3286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:41:50.839146 3286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:41:50.843878 3286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:41:50.844158 3286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:41:50.845233 3286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:41:50.846797 3286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:41:50.846902 3286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 08:41:50.847004 3286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:41:50.847049 3286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:41:50.885165 3286 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:33951
I20260808 08:41:50.885281 3504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:33951 every 8 connection(s)
I20260808 08:41:50.886662 3286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:41:50.888984 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 3286
I20260808 08:41:50.889274 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:41:50.889981 20427 external_mini_cluster.cc:1428] Setting key 451a9f5d5d299efc9e953a86cc404e16
Aug 08 08:41:50 dist-test-slave-39l8 krb5kdc[2746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178510, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:41:50.910130 3513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.889959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:48789 (local address 127.19.242.254:36887)
0808 08:41:50.890563 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:50.890570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:50.892026 (+ 1456us) server_negotiation.cc:407] Connection header received
0808 08:41:50.894583 (+ 2557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:50.894588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:50.894688 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:50.894904 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:50.896653 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.897436 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.899203 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.899623 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.899770 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.903788 (+ 4018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:50.903800 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:50.903809 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:50.903867 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:50.906906 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:50.907782 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:50.907786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:50.907788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:50.907914 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:50.908388 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:50.908392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:50.908394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:50.908739 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:50.908867 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:50.909655 (+ 788us) server_negotiation.cc:299] Negotiation successful
0808 08:41:50.909848 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":276,"threads_started":1}
I20260808 08:41:50.911314 3515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.890605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36887 (local address 127.19.242.195:48789)
0808 08:41:50.891769 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:50.891840 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:50.894264 (+ 2424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:50.895198 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:50.895208 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:50.895816 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:41:50.896449 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.896467 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.897625 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.897630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.899032 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.899046 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.899905 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.899913 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.900171 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.901007 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:41:50.901046 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:41:50.903460 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:41:50.907069 (+ 3609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:50.907139 (+ 70us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:50.907155 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:50.907653 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:50.908014 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:41:50.908018 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:41:50.908020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:41:50.908280 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:41:50.908867 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:41:50.908873 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:41:50.909291 (+ 418us) client_negotiation.cc:769] Sending connection context
0808 08:41:50.909541 (+ 250us) client_negotiation.cc:240] Negotiation successful
0808 08:41:50.909989 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":804,"thread_start_us":434,"threads_started":1}
I20260808 08:41:50.913024 3510 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36887
I20260808 08:41:50.913446 3510 heartbeater.cc:464] Registering TS with master...
I20260808 08:41:50.914374 3510 heartbeater.cc:511] Master 127.19.242.254:36887 requested a full tablet report, sending...
I20260808 08:41:50.916321 2808 ts_manager.cc:194] Registered new tserver with Master: c729147c27294a24b4170cb8dde7a18a (127.19.242.195:33951)
I20260808 08:41:50.917573 2808 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:48789
I20260808 08:41:50.919791 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:41:50.938958 3513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.925173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45152 (local address 127.19.242.254:36887)
0808 08:41:50.925436 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:50.925444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:50.925766 (+ 322us) server_negotiation.cc:407] Connection header received
0808 08:41:50.925906 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:50.925910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:50.925979 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:50.926072 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:50.927691 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.928469 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.929776 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.930186 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.930298 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.933007 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:50.933013 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:50.933016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:50.933059 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:50.936020 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:50.936910 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:50.936915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:50.936917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:50.937070 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:50.937430 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:50.937434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:50.937436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:50.937812 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:50.938060 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:50.938368 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 08:41:50.938560 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:41:50.943974 2808 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:41:50.952313 2808 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:41:50.985538 3526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.967570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:35970)
0808 08:41:50.969188 (+ 1618us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:50.969249 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:50.969558 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:50.973330 (+ 3772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:50.973343 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:50.973402 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:50.974150 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.974172 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.977870 (+ 3698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.977883 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.981721 (+ 3838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.981759 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.984280 (+ 2521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.984287 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.984560 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.984656 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 08:41:50.984835 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 08:41:50.985115 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1202,"thread_start_us":15324,"threads_started":1}
I20260808 08:41:50.986428 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.967915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35970 (local address 127.19.242.193:45327)
0808 08:41:50.970575 (+ 2660us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:50.970592 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:50.970637 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:41:50.970813 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:50.970827 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:50.971275 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:50.974477 (+ 3202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:50.974894 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.977574 (+ 2680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.982194 (+ 4620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.983980 (+ 1786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.984278 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.984489 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:50.985894 (+ 1405us) server_negotiation.cc:299] Negotiation successful
0808 08:41:50.986146 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2387,"thread_start_us":2144,"threads_started":1}
I20260808 08:41:50.991644 2978 tablet_service.cc:1467] Processing CreateTablet for tablet f899a90b865347b1ba9f4ccc30988a3c (DEFAULT_TABLE table=test-table [id=28253c37797b47bbbd4825509315fc30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:50.993503 2978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f899a90b865347b1ba9f4ccc30988a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:50.994673 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.967926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:33273 (local address 127.0.0.1:36456)
0808 08:41:50.972787 (+ 4861us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:50.972818 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:50.973017 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:50.986290 (+ 13273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:50.986294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:50.986328 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:50.986750 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.986768 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.989747 (+ 2979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.989754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.991395 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.991412 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.993208 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.993215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.993408 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.993458 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 08:41:50.993637 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 08:41:50.994127 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3970,"mutex_wait_us":1,"thread_start_us":4998,"threads_started":1}
I20260808 08:41:50.995555 3530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.969452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36456 (local address 127.19.242.194:33273)
0808 08:41:50.985719 (+ 16267us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:50.985730 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:50.985761 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:41:50.985849 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:50.985856 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:50.986056 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:50.986306 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:50.986980 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.989439 (+ 2459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.991577 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.992944 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.993140 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.993334 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:50.995054 (+ 1720us) server_negotiation.cc:299] Negotiation successful
0808 08:41:50.995256 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16082,"thread_start_us":15964,"threads_started":1}
I20260808 08:41:50.995707 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.970134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52918 (local address 127.19.242.195:33951)
0808 08:41:50.985223 (+ 15089us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:50.985234 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:50.985280 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:41:50.985401 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:50.985411 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:50.986591 (+ 1180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:50.986860 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:50.987599 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.989194 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.992164 (+ 2970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.993626 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.993842 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.994023 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:50.995178 (+ 1155us) server_negotiation.cc:299] Negotiation successful
0808 08:41:50.995347 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14886,"thread_start_us":14642,"threads_started":1}
I20260808 08:41:50.996047 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:50.968897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33951 (local address 127.0.0.1:52918)
0808 08:41:50.982562 (+ 13665us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:50.982588 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:50.982769 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:50.986867 (+ 4098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:50.986871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:50.986929 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:50.987360 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.987378 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.989367 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.989373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.991938 (+ 2565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:50.991957 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:50.993870 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:50.993877 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:50.994048 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:50.994091 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:41:50.994204 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:41:50.994367 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13469,"mutex_wait_us":83,"thread_start_us":2805,"threads_started":1}
I20260808 08:41:51.000067 3171 tablet_service.cc:1467] Processing CreateTablet for tablet f899a90b865347b1ba9f4ccc30988a3c (DEFAULT_TABLE table=test-table [id=28253c37797b47bbbd4825509315fc30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:51.000367 3389 tablet_service.cc:1467] Processing CreateTablet for tablet f899a90b865347b1ba9f4ccc30988a3c (DEFAULT_TABLE table=test-table [id=28253c37797b47bbbd4825509315fc30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:41:51.001586 3171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f899a90b865347b1ba9f4ccc30988a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:51.002034 3389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f899a90b865347b1ba9f4ccc30988a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:41:51.018263 3534 tablet_bootstrap.cc:492] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: Bootstrap starting.
I20260808 08:41:51.022969 3535 tablet_bootstrap.cc:492] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Bootstrap starting.
I20260808 08:41:51.025132 3534 tablet_bootstrap.cc:654] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:51.026656 3535 tablet_bootstrap.cc:654] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:51.026990 3534 log.cc:824] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:51.027630 3536 tablet_bootstrap.cc:492] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Bootstrap starting.
I20260808 08:41:51.028017 3535 log.cc:824] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:51.032742 3535 tablet_bootstrap.cc:492] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: No bootstrap required, opened a new log
I20260808 08:41:51.034469 3535 ts_tablet_manager.cc:1397] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 08:41:51.034654 3536 tablet_bootstrap.cc:654] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Neither blocks nor log segments found. Creating new log.
I20260808 08:41:51.036235 3536 log.cc:824] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:41:51.041049 3534 tablet_bootstrap.cc:492] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: No bootstrap required, opened a new log
I20260808 08:41:51.041491 3534 ts_tablet_manager.cc:1397] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.010s
I20260808 08:41:51.046698 3535 raft_consensus.cc:348] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.047323 3535 raft_consensus.cc:374] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:51.047431 3535 raft_consensus.cc:729] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b96cb6f5ce34002a09744914c3b8c47, State: Initialized, Role: FOLLOWER
I20260808 08:41:51.048796 3535 consensus_queue.cc:260] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.050247 3278 heartbeater.cc:503] Master 127.19.242.254:36887 was elected leader, sending a full tablet report...
I20260808 08:41:51.051385 3536 tablet_bootstrap.cc:492] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: No bootstrap required, opened a new log
I20260808 08:41:51.051795 3536 ts_tablet_manager.cc:1397] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Time spent bootstrapping tablet: real 0.024s user 0.016s sys 0.000s
I20260808 08:41:51.056401 3535 ts_tablet_manager.cc:1428] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Time spent starting tablet: real 0.022s user 0.010s sys 0.004s
I20260808 08:41:51.056252 3534 raft_consensus.cc:348] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.056854 3534 raft_consensus.cc:374] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:51.056994 3534 raft_consensus.cc:729] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9f4cd92bb444cc48f9cb8ef28036af4, State: Initialized, Role: FOLLOWER
I20260808 08:41:51.057962 3534 consensus_queue.cc:260] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.062263 3534 ts_tablet_manager.cc:1428] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: Time spent starting tablet: real 0.021s user 0.018s sys 0.002s
I20260808 08:41:51.064254 3536 raft_consensus.cc:348] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.064905 3536 raft_consensus.cc:374] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:41:51.065073 3536 raft_consensus.cc:729] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c729147c27294a24b4170cb8dde7a18a, State: Initialized, Role: FOLLOWER
I20260808 08:41:51.065842 3536 consensus_queue.cc:260] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.067349 3510 heartbeater.cc:503] Master 127.19.242.254:36887 was elected leader, sending a full tablet report...
I20260808 08:41:51.068063 3536 ts_tablet_manager.cc:1428] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260808 08:41:51.115123 3542 raft_consensus.cc:482] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:41:51.115523 3542 raft_consensus.cc:504] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.117380 3542 leader_election.cc:288] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9f4cd92bb444cc48f9cb8ef28036af4 (127.19.242.193:45327), c729147c27294a24b4170cb8dde7a18a (127.19.242.195:33951)
I20260808 08:41:51.126778 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.117889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:50935 (local address 127.19.242.193:45327)
0808 08:41:51.118098 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:51.118105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:51.119095 (+ 990us) server_negotiation.cc:407] Connection header received
0808 08:41:51.119295 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:51.119302 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:51.119388 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:51.119502 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:51.120591 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.121329 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.124727 (+ 3398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.125560 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.125714 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.125782 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:51.126279 (+ 497us) server_negotiation.cc:299] Negotiation successful
0808 08:41:51.126423 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:41:51.127027 3547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.117861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.19.242.194:50935)
0808 08:41:51.118893 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.118917 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:51.119130 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:51.119544 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:51.119549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:51.119611 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:51.120316 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:51.120342 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.121499 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.121506 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:51.124497 (+ 2991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:51.124521 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.125819 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.125827 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:51.125973 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.126002 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 08:41:51.126235 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 08:41:51.126421 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":892,"mutex_wait_us":202,"spinlock_wait_cycles":78208,"thread_start_us":490,"threads_started":1}
I20260808 08:41:51.128041 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.117889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:45099 (local address 127.19.242.195:33951)
0808 08:41:51.118098 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:51.118105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:51.119033 (+ 928us) server_negotiation.cc:407] Connection header received
0808 08:41:51.119296 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:51.119301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:51.119388 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:51.119503 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:41:51.120556 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.121518 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.125887 (+ 4369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.126837 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.127033 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.127104 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:51.127630 (+ 526us) server_negotiation.cc:299] Negotiation successful
0808 08:41:51.127780 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:41:51.128150 3546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.117758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33951 (local address 127.19.242.194:45099)
0808 08:41:51.118894 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.118917 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:41:51.119099 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:41:51.119544 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:41:51.119549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:41:51.119611 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:41:51.120354 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:51.120367 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.121681 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.121690 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:51.124497 (+ 2807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:41:51.124521 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.127294 (+ 2773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.127301 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:41:51.127451 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.127478 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:41:51.127597 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:41:51.127742 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":323,"spinlock_wait_cycles":26880,"thread_start_us":552,"threads_started":1}
I20260808 08:41:51.128252 3005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f899a90b865347b1ba9f4ccc30988a3c" candidate_uuid: "1b96cb6f5ce34002a09744914c3b8c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" is_pre_election: true
I20260808 08:41:51.128944 3005 raft_consensus.cc:2454] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b96cb6f5ce34002a09744914c3b8c47 in term 0.
I20260808 08:41:51.129295 3425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f899a90b865347b1ba9f4ccc30988a3c" candidate_uuid: "1b96cb6f5ce34002a09744914c3b8c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c729147c27294a24b4170cb8dde7a18a" is_pre_election: true
I20260808 08:41:51.129818 3107 leader_election.cc:302] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b96cb6f5ce34002a09744914c3b8c47, c9f4cd92bb444cc48f9cb8ef28036af4; no voters:
I20260808 08:41:51.129942 3425 raft_consensus.cc:2454] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b96cb6f5ce34002a09744914c3b8c47 in term 0.
I20260808 08:41:51.130359 3542 raft_consensus.cc:2781] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:41:51.130627 3542 raft_consensus.cc:482] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:41:51.130822 3542 raft_consensus.cc:3037] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:51.133638 3542 raft_consensus.cc:504] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.134574 3542 leader_election.cc:288] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [CANDIDATE]: Term 1 election: Requested vote from peers c9f4cd92bb444cc48f9cb8ef28036af4 (127.19.242.193:45327), c729147c27294a24b4170cb8dde7a18a (127.19.242.195:33951)
I20260808 08:41:51.135272 3005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f899a90b865347b1ba9f4ccc30988a3c" candidate_uuid: "1b96cb6f5ce34002a09744914c3b8c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4"
I20260808 08:41:51.135375 3425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f899a90b865347b1ba9f4ccc30988a3c" candidate_uuid: "1b96cb6f5ce34002a09744914c3b8c47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c729147c27294a24b4170cb8dde7a18a"
I20260808 08:41:51.135540 3005 raft_consensus.cc:3037] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:41:51.135601 3425 raft_consensus.cc:3037] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 0 FOLLOWER]: Advancing to term 1
W20260808 08:41:51.138502 3512 tablet.cc:2369] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:41:51.139119 3425 raft_consensus.cc:2454] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b96cb6f5ce34002a09744914c3b8c47 in term 1.
I20260808 08:41:51.139114 3005 raft_consensus.cc:2454] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b96cb6f5ce34002a09744914c3b8c47 in term 1.
I20260808 08:41:51.139683 3106 leader_election.cc:302] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b96cb6f5ce34002a09744914c3b8c47, c729147c27294a24b4170cb8dde7a18a; no voters:
I20260808 08:41:51.140177 3542 raft_consensus.cc:2781] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:41:51.140658 3542 raft_consensus.cc:686] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 1 LEADER]: Becoming Leader. State: Replica: 1b96cb6f5ce34002a09744914c3b8c47, State: Running, Role: LEADER
I20260808 08:41:51.141290 3542 consensus_queue.cc:237] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } }
I20260808 08:41:51.146298 2808 catalog_manager.cc:5495] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b96cb6f5ce34002a09744914c3b8c47 (127.19.242.194). New cstate: current_term: 1 leader_uuid: "1b96cb6f5ce34002a09744914c3b8c47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b96cb6f5ce34002a09744914c3b8c47" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 33273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 } health_report { overall_health: UNKNOWN } } }
I20260808 08:41:51.190801 3530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.185298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36472 (local address 127.19.242.194:33273)
0808 08:41:51.185495 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:51.185499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:51.185518 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:41:51.185685 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:51.185689 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:51.185772 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:51.185937 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:41:51.186266 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.187018 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.188375 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.188787 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.188886 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.189380 (+ 494us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:41:51.189983 (+ 603us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:41:51.190219 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:51.190317 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 08:41:51.190407 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:41:51.200323 3425 raft_consensus.cc:1261] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 1 FOLLOWER]: Refusing update from remote peer 1b96cb6f5ce34002a09744914c3b8c47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:51.200320 3005 raft_consensus.cc:1261] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 1 FOLLOWER]: Refusing update from remote peer 1b96cb6f5ce34002a09744914c3b8c47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:41:51.201587 3542 consensus_queue.cc:1035] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9f4cd92bb444cc48f9cb8ef28036af4" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:41:51.201941 3548 consensus_queue.cc:1035] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c729147c27294a24b4170cb8dde7a18a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:41:51.211352 3074 tablet.cc:2369] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:41:51.214345 3556 mvcc.cc:205] Tried to move back new op lower bound from 7316187181864443904 to 7316187181639237632. Current Snapshot: MvccSnapshot[applied={T|T < 7316187181864443904}]
I20260808 08:41:51.225353 3554 mvcc.cc:205] Tried to move back new op lower bound from 7316187181864443904 to 7316187181639237632. Current Snapshot: MvccSnapshot[applied={T|T < 7316187181864443904}]
I20260808 08:41:51.230537 2807 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:51.231019 2807 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:41:51.235365 2807 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b84ad580e2bf46648a68143343e2d11f: Sending DeleteTablet for 3 replicas of tablet f899a90b865347b1ba9f4ccc30988a3c
I20260808 08:41:51.236920 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet f899a90b865347b1ba9f4ccc30988a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:51 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:52918
I20260808 08:41:51.236920 2978 tablet_service.cc:1514] Processing DeleteTablet for tablet f899a90b865347b1ba9f4ccc30988a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:51 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:35970
I20260808 08:41:51.236959 3171 tablet_service.cc:1514] Processing DeleteTablet for tablet f899a90b865347b1ba9f4ccc30988a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:41:51 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:36456
I20260808 08:41:51.245535 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 2891
I20260808 08:41:51.251370 3573 tablet_replica.cc:330] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: stopping tablet replica
I20260808 08:41:51.251957 3573 raft_consensus.cc:2229] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:41:51.252749 3573 raft_consensus.cc:2258] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:51.255622 3573 ts_tablet_manager.cc:1905] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:51.262182 3569 tablet_replica.cc:330] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: stopping tablet replica
Aug 08 08:41:51 dist-test-slave-39l8 krb5kdc[2746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:41:51.263191 3569 raft_consensus.cc:2229] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:51.264098 3569 raft_consensus.cc:2258] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:51.265159 3574 tablet_replica.cc:330] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: stopping tablet replica
I20260808 08:41:51.265676 3574 raft_consensus.cc:2229] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:41:51.266227 3574 raft_consensus.cc:2258] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:41:51.267810 3573 ts_tablet_manager.cc:1918] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:51.268005 3573 log.cc:1196] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/f899a90b865347b1ba9f4ccc30988a3c
I20260808 08:41:51.268606 3573 ts_tablet_manager.cc:1939] T f899a90b865347b1ba9f4ccc30988a3c P 1b96cb6f5ce34002a09744914c3b8c47: Deleting consensus metadata
I20260808 08:41:51.268647 3569 ts_tablet_manager.cc:1905] T f899a90b865347b1ba9f4ccc30988a3c P c9f4cd92bb444cc48f9cb8ef28036af4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:51.270622 2786 catalog_manager.cc:4841] TS 1b96cb6f5ce34002a09744914c3b8c47 (127.19.242.194:33273): tablet f899a90b865347b1ba9f4ccc30988a3c (table test-table [id=28253c37797b47bbbd4825509315fc30]) successfully deleted
I20260808 08:41:51.272498 3574 ts_tablet_manager.cc:1905] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:41:51.273135 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.247832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35982 (local address 127.19.242.193:45327)
0808 08:41:51.248118 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:51.248128 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:51.251622 (+ 3494us) server_negotiation.cc:407] Connection header received
0808 08:41:51.251977 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:51.251986 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:51.252124 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:51.252209 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:51.254214 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.255564 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.257587 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.258383 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.258502 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.264587 (+ 6085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:51.264608 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:51.264628 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:51.264691 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:51.268875 (+ 4184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:51.269931 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:51.269941 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:51.269947 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:51.270217 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:51.270916 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:51.270921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:51.270924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:51.271480 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:51.271793 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:51.272485 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 08:41:51.272744 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 08:41:51.273957 3063 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:51.284961 3574 ts_tablet_manager.cc:1918] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:41:51.285418 3574 log.cc:1196] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/f899a90b865347b1ba9f4ccc30988a3c
I20260808 08:41:51.286065 3574 ts_tablet_manager.cc:1939] T f899a90b865347b1ba9f4ccc30988a3c P c729147c27294a24b4170cb8dde7a18a: Deleting consensus metadata
I20260808 08:41:51.288298 2788 catalog_manager.cc:4841] TS c729147c27294a24b4170cb8dde7a18a (127.19.242.195:33951): tablet f899a90b865347b1ba9f4ccc30988a3c (table test-table [id=28253c37797b47bbbd4825509315fc30]) successfully deleted
I20260808 08:41:51.404188 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 2891
W20260808 08:41:51.440936 2789 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.242.193:45327 (error 108)
I20260808 08:41:51.441816 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 3080
I20260808 08:41:51.443279 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.442668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48114)
0808 08:41:51.442937 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.443070 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260808 08:41:51.443595 2789 catalog_manager.cc:4584] TS c9f4cd92bb444cc48f9cb8ef28036af4 (127.19.242.193:45327): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f899a90b865347b1ba9f4ccc30988a3c: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Aug 08 08:41:51 dist-test-slave-39l8 krb5kdc[2746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:41:51.462260 3530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.442660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59744 (local address 127.19.242.194:33273)
0808 08:41:51.442873 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:51.442881 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:51.443041 (+ 160us) server_negotiation.cc:407] Connection header received
0808 08:41:51.443244 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:51.443249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:51.443357 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:51.443476 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:51.445018 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.446317 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.447905 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.448656 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.448820 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.453996 (+ 5176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:51.454020 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:51.454043 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:51.454100 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:51.458648 (+ 4548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:51.459616 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:51.459627 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:51.459631 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:51.459822 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:51.460385 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:51.460391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:51.460394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:51.460900 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:51.461256 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:51.461635 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 08:41:51.461883 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:41:51.463256 3273 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:51.497481 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.496930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48130)
0808 08:41:51.497167 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.497301 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 08:41:51.498756 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.498303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48144)
0808 08:41:51.498472 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.498574 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 08:41:51.559494 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.558947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48148)
0808 08:41:51.559178 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.559289 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 08:41:51.560822 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.560367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48156)
0808 08:41:51.560577 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.560664 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 08:41:51.582545 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 3080
I20260808 08:41:51.611496 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 3286
Aug 08 08:41:51 dist-test-slave-39l8 krb5kdc[2746](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:41:51.628636 3532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.612395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53650 (local address 127.19.242.195:33951)
0808 08:41:51.612598 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 08:41:51.612605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:41:51.612646 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:41:51.612889 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:41:51.612894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:41:51.612961 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:41:51.613074 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:41:51.614627 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.615434 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.616799 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:41:51.617211 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:41:51.617358 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:41:51.622372 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:41:51.622392 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:41:51.622410 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:41:51.622465 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:41:51.625563 (+ 3098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:51.626472 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:51.626481 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:51.626483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:51.626767 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:41:51.627189 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:41:51.627192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:41:51.627194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:41:51.627621 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:41:51.627857 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 08:41:51.628137 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 08:41:51.628320 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:41:51.629324 3500 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:51.641837 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.641284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48160)
0808 08:41:51.641530 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.641635 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 08:41:51.643213 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.642787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48174)
0808 08:41:51.643008 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.643088 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260808 08:41:51.722937 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 3286
I20260808 08:41:51.748813 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 2764
I20260808 08:41:51.750177 2847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:41:51.861594 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 2764
I20260808 08:41:51.861665 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:41:51.861007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45327 (local address 127.0.0.1:48180)
0808 08:41:51.861266 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 08:41:51.861372 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
2026-08-08T08:41:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5031 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:41:51 dist-test-slave-39l8 krb5kdc[3589](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:41:51 dist-test-slave-39l8 krb5kdc[3589](info): set up 2 sockets
Aug 08 08:41:51 dist-test-slave-39l8 krb5kdc[3589](info): commencing operation
krb5kdc: starting...
W20260808 08:41:53.238428 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:41:53 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:41:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:41:53Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/rangeradmin_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/rangeradmin_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/rangerlookup_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/rangerlookup_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
I20260808 08:41:53.722285 20427 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskkvSB7S/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/postgres -l logfile start
2026-08-08 08:41:56.484 UTC [3629] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:41:56.484 UTC [3629] LOG: listening on IPv4 address "127.19.242.212", port 41851
2026-08-08 08:41:56.487 UTC [3629] LOG: listening on Unix socket "/tmp/.s.PGSQL.41851"
2026-08-08 08:41:56.515 UTC [3632] LOG: database system was shut down at 2026-08-08 08:41:54 UTC
2026-08-08 08:41:56.519 UTC [3629] LOG: database system is ready to accept connections
I20260808 08:41:57.705149 20427 mini_postgres.cc:96] Postgres bound to 41851
2026-08-08 08:41:57.733 UTC [3648] FATAL: database "slave" does not exist
127.19.242.212:41851 - accepting connections
I20260808 08:41:57.734797 20427 mini_ranger.cc:161] Starting Ranger...
I20260808 08:41:57.773283 20427 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:41:58.331400 20427 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:41:58.331578 20427 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-admin
2026-08-08 08:41:58,695 [I] DB FLAVOR :POSTGRES
2026-08-08 08:41:58,695 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:41:58,696 [I] Checking connection..
2026-08-08 08:41:58,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:41:58,981 [I] Checking connection passed.
2026-08-08 08:41:58,982 [I] --------- Verifying version history table ---------
2026-08-08 08:41:58,982 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:41:59,250 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:41:59,251 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:41:59,535 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:41:59,535 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:41:59,535 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:41:59.808 UTC [3746] WARNING: there is no transaction in progress
2026-08-08 08:41:59,818 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:41:59,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:42:00,127 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:42:00,128 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:42:00,128 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:42:00,415 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:42:00,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-39l8.c.gcp-upstream.internal','N') ;"
2026-08-08 08:42:00,960 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:42:01,263 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:42:01,263 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:42:01,553 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:42:01,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:42:01,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:42:02,123 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:42:02,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:42:03.222 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.240 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.259 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.277 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.296 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.317 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.385 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.394 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.411 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.423 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.435 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.451 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.463 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.472 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.480 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:03.489 UTC [3913] WARNING: there is no transaction in progress
2026-08-08 08:42:04,271 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:42:04,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:42:04,536 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:42:04,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:42:04,801 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:42:04,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:42:05,081 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:42:05,082 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:42:05,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:42:05,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-39l8.c.gcp-upstream.internal';"
2026-08-08 08:42:05,910 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:42:05,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:42:06,182 [I] DB_PATCHES have already been applied
I20260808 08:42:06.189098 20427 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-admin:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskkvSB7S/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:42:06.189213 20427 mini_ranger.cc:193] Using host: 127.19.242.212
I20260808 08:42:06.215061 20427 mini_ranger.cc:227] Ranger admin URL: http://127.19.242.212:53099
Aug 08, 2026 8:42:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:42:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:42:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:42:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:42:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:42:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:42:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:42:07.618417 20427 mini_ranger.cc:160] Time spent starting Ranger: real 9.884s user 0.004s sys 0.077s
Aug 08, 2026 8:42:28 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:42:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 8:42:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:42:28 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:42:29 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:42:30.488886 20427 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/rangerkms_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/rangerkms_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.242.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.242.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:42:30 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178550, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:42:30.721648 20427 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:42:30.752637 20427 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:42:31.658855 20427 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:42:31.659106 20427 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms
I20260808 08:42:31.659233 20427 mini_ranger_kms.cc:227] Using postgres at 127.19.242.212:41851
2026-08-08 08:42:32,193 [I] DB FLAVOR :POSTGRES
2026-08-08 08:42:32,194 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:42:32,194 [I] Checking connection
2026-08-08 08:42:32,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:42:32,494 [I] connection success
2026-08-08 08:42:32,494 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:42:32,494 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:42:32,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:42:32,757 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:42:32,758 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:42:32,758 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:42:32,758 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:41851/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:42:33,064 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:42:33.620380 20427 mini_ranger_kms.cc:310] Created kms service
I20260808 08:42:33.850425 20427 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:42:33.902874 20427 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:42:33 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178550, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:42:34.331141 20427 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:42:34.332520 20427 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms:/tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:42:34.332608 20427 mini_ranger_kms.cc:240] Using host: 127.19.242.212
I20260808 08:42:34.368587 20427 mini_ranger_kms.cc:276] Ranger KMS PID: 4184
I20260808 08:42:34.368840 20427 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.242.212:40885
Aug 08, 2026 8:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:42:35 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 08:42:36 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178556, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.242.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:42:37.235914 20427 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.514s user 0.135s sys 0.452s
I20260808 08:42:37.236297 20427 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:42:37.236548 20427 mini_ranger_kms.cc:401] 127.19.242.212:40885/kms/v1/keys
Aug 08 08:42:37 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178556, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.242.212@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
Aug 08 08:42:37 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178556, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.242.212@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
Aug 08 08:42:40 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:42:40.313016 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46435
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:46435
--ranger_config_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:40885/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:42:40.720810 4249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:42:40.721163 4249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:42:40.721354 4249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:42:40.728984 4249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:42:40.729125 4249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:42:40.729225 4249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:42:40.729318 4249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:42:40.729434 4249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:42:40.740702 4249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.242.212:40885/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:46435
--ranger_config_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:42:40.742333 4249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:42:40.743829 4249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:42:40.757858 4259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:42:40.757936 4261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:42:40.758829 4265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:42:40.758906 4249 server_base.cc:1034] running on GCE node
I20260808 08:42:40.759969 4249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:42:40.761703 4249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:42:40.763012 4249 hybrid_clock.cc:648] HybridClock initialized: now 1786178560762956 us; error 51 us; skew 500 ppm
I20260808 08:42:40.763495 4249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:42:40 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178560, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:42:40.771843 4249 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:42:40.773701 4249 webserver.cc:460] Webserver started at http://127.19.242.254:39287/ using document root <none> and password file <none>
I20260808 08:42:40.774477 4249 fs_manager.cc:359] Metadata directory not provided
I20260808 08:42:40.774632 4249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:42:40.775013 4249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:42:40 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178560, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:42:40.830397 4249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "79acaf35015b4c6587488b9cb7da4927"
format_stamp: "Formatted at 2026-08-08 08:42:40 on dist-test-slave-39l8"
server_key: "579f9621cd5934ce06bf9ed1e980b5eb"
server_key_iv: "47e328448e1405448fef0f05bc334343"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:40.831735 4249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "79acaf35015b4c6587488b9cb7da4927"
format_stamp: "Formatted at 2026-08-08 08:42:40 on dist-test-slave-39l8"
server_key: "579f9621cd5934ce06bf9ed1e980b5eb"
server_key_iv: "47e328448e1405448fef0f05bc334343"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:40.839996 4249 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260808 08:42:40.858947 4276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:40.860687 4249 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:42:40.860914 4249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "79acaf35015b4c6587488b9cb7da4927"
format_stamp: "Formatted at 2026-08-08 08:42:40 on dist-test-slave-39l8"
server_key: "579f9621cd5934ce06bf9ed1e980b5eb"
server_key_iv: "47e328448e1405448fef0f05bc334343"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:40.861181 4249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:42:40.882975 4249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:42:40.887982 4249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:42:40.888352 4249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:42:40.911470 4249 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:46435
I20260808 08:42:40.911571 4358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:46435 every 8 connection(s)
I20260808 08:42:40.913072 4249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:42:40.916510 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 4249
I20260808 08:42:40.916733 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:42:40.917480 20427 external_mini_cluster.cc:1428] Setting key 7db5bc0be7731ee42c95b4fbc3aa9fc1
I20260808 08:42:40.918515 4359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:42:40 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:42:40.934873 4359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927: Bootstrap starting.
I20260808 08:42:40.939031 4359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927: Neither blocks nor log segments found. Creating new log.
I20260808 08:42:40.940395 4359 log.cc:824] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927: Log is configured to *not* fsync() on all Append() calls
I20260808 08:42:40.943401 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:40.919693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58228 (local address 127.19.242.254:46435)
0808 08:42:40.920700 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:40.920713 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:40.920770 (+ 57us) server_negotiation.cc:407] Connection header received
0808 08:42:40.922391 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:40.922416 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:40.922922 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:40.923297 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:40.925092 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:40.926576 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:40.928426 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:40.929144 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:40.929289 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:40.934332 (+ 5043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:40.934343 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:40.934361 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:40.934412 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:40.937909 (+ 3497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:40.938983 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:40.938991 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:40.938997 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:40.939278 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:40.939809 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:40.939813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:40.939815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:40.940547 (+ 732us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:40.940866 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:40.941599 (+ 733us) server_negotiation.cc:299] Negotiation successful
0808 08:42:40.942211 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":477,"threads_started":1}
I20260808 08:42:40.944316 4359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927: No bootstrap required, opened a new log
I20260808 08:42:40.953241 4359 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79acaf35015b4c6587488b9cb7da4927" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46435 } }
I20260808 08:42:40.953850 4359 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:42:40.953969 4359 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79acaf35015b4c6587488b9cb7da4927, State: Initialized, Role: FOLLOWER
I20260808 08:42:40.954684 4359 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79acaf35015b4c6587488b9cb7da4927" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46435 } }
I20260808 08:42:40.954998 4359 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:42:40.955138 4359 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:42:40.955351 4359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:42:40.958375 4359 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79acaf35015b4c6587488b9cb7da4927" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46435 } }
I20260808 08:42:40.959182 4359 leader_election.cc:302] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79acaf35015b4c6587488b9cb7da4927; no voters:
I20260808 08:42:40.966825 4359 leader_election.cc:288] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:42:40.966845 4369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:42:40.973838 4369 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [term 1 LEADER]: Becoming Leader. State: Replica: 79acaf35015b4c6587488b9cb7da4927, State: Running, Role: LEADER
I20260808 08:42:40.974573 4369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79acaf35015b4c6587488b9cb7da4927" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46435 } }
I20260808 08:42:40.975164 4359 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:42:40.978207 4371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79acaf35015b4c6587488b9cb7da4927. Latest consensus state: current_term: 1 leader_uuid: "79acaf35015b4c6587488b9cb7da4927" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79acaf35015b4c6587488b9cb7da4927" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46435 } } }
I20260808 08:42:40.978912 4371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [sys.catalog]: This master's current role is: LEADER
I20260808 08:42:40.980863 4380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:42:40.980857 4372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79acaf35015b4c6587488b9cb7da4927" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79acaf35015b4c6587488b9cb7da4927" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46435 } } }
I20260808 08:42:40.981333 4372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927 [sys.catalog]: This master's current role is: LEADER
I20260808 08:42:40.987658 4380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:42:40.988996 4359 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:42:41.009686 4380 catalog_manager.cc:1347] Generated new cluster ID: a9d016a6da64489eaea4be6e00cd2700
I20260808 08:42:41.009902 4380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:42:41.038358 4380 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:42:41.041028 4380 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:42:41.050863 4380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927: Generated new TSK 0
I20260808 08:42:41.052114 4380 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:42:41.883074 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:40885/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46435
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:42:42 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178562, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:42:42.332705 4428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:42:42.333084 4428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:42:42.333266 4428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:42:42.342808 4428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:42:42.343011 4428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:42:42.343201 4428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:42:42.355463 4428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.242.212:40885/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46435
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:42:42.357105 4428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:42:42.358642 4428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:42:42.379743 4441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:42:42.384029 4442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:42:42.385619 4445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:42:42.386145 4428 server_base.cc:1034] running on GCE node
I20260808 08:42:42.387007 4428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:42:42.388408 4428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:42:42.389765 4428 hybrid_clock.cc:648] HybridClock initialized: now 1786178562389689 us; error 83 us; skew 500 ppm
I20260808 08:42:42.390333 4428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:42:42 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178562, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:42:42.394634 4428 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:42:42.399204 4428 webserver.cc:460] Webserver started at http://127.19.242.193:41947/ using document root <none> and password file <none>
I20260808 08:42:42.400274 4428 fs_manager.cc:359] Metadata directory not provided
I20260808 08:42:42.400457 4428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:42:42.400833 4428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:42:42 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178562, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:42:42.424443 4428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "df31cbb59ac24d3abd24abbfad7b6a92"
format_stamp: "Formatted at 2026-08-08 08:42:42 on dist-test-slave-39l8"
server_key: "2657a80f6917852ac8ed4760ce538c3a"
server_key_iv: "aadb84c50fbb51b98aa4613578821032"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:42.425896 4428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "df31cbb59ac24d3abd24abbfad7b6a92"
format_stamp: "Formatted at 2026-08-08 08:42:42 on dist-test-slave-39l8"
server_key: "2657a80f6917852ac8ed4760ce538c3a"
server_key_iv: "aadb84c50fbb51b98aa4613578821032"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:42.436914 4428 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.008s sys 0.000s
I20260808 08:42:42.473346 4454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:42.476818 4428 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.002s
I20260808 08:42:42.477151 4428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "df31cbb59ac24d3abd24abbfad7b6a92"
format_stamp: "Formatted at 2026-08-08 08:42:42 on dist-test-slave-39l8"
server_key: "2657a80f6917852ac8ed4760ce538c3a"
server_key_iv: "aadb84c50fbb51b98aa4613578821032"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:42.477542 4428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:42:42.507318 4428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:42:42.512341 4428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:42:42.512701 4428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:42:42.513849 4428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:42:42.515620 4428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:42:42.515740 4428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:42.515900 4428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:42:42.516021 4428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:42.648520 4428 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:33255
I20260808 08:42:42.648553 4625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:33255 every 8 connection(s)
I20260808 08:42:42.650592 4428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:42:42.655339 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 4428
I20260808 08:42:42.655663 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:42:42.656822 20427 external_mini_cluster.cc:1428] Setting key 0c7d8225433daf00e2c76d4ae479a610
Aug 08 08:42:42 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178562, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:42:42.691043 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:42.656066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:50663 (local address 127.19.242.254:46435)
0808 08:42:42.659400 (+ 3334us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:42.659411 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:42.664659 (+ 5248us) server_negotiation.cc:407] Connection header received
0808 08:42:42.664748 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:42.664754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:42.664857 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:42.664984 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:42.669492 (+ 4508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:42.670848 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:42.674052 (+ 3204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:42.674833 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:42.674963 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:42.680710 (+ 5747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:42.680719 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:42.680724 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:42.680779 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:42.685746 (+ 4967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:42.687188 (+ 1442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:42.687199 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:42.687204 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:42.687434 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:42.688264 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:42.688271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:42.688274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:42.688740 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:42.688910 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:42.690244 (+ 1334us) server_negotiation.cc:299] Negotiation successful
0808 08:42:42.690539 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3143,"thread_start_us":2956,"threads_started":1}
I20260808 08:42:42.693416 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:42.655182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:46435 (local address 127.19.242.193:50663)
0808 08:42:42.661289 (+ 6107us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:42.661354 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:42.664169 (+ 2815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:42.666079 (+ 1910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:42.666095 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:42.668105 (+ 2010us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:42:42.669192 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:42.669229 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:42.671139 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:42.671145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:42.673776 (+ 2631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:42.673799 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:42.675412 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:42.675422 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:42.675765 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:42.676753 (+ 988us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:42:42.676792 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:42:42.680313 (+ 3521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:42:42.686070 (+ 5757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:42:42.686081 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:42:42.686104 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:42:42.686971 (+ 867us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:42:42.687676 (+ 705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:42:42.687683 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:42:42.687687 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:42:42.688077 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:42:42.689079 (+ 1002us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:42:42.689090 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:42:42.689640 (+ 550us) client_negotiation.cc:769] Sending connection context
0808 08:42:42.691691 (+ 2051us) client_negotiation.cc:240] Negotiation successful
0808 08:42:42.692247 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5769,"thread_start_us":4410,"threads_started":1}
I20260808 08:42:42.696048 4626 heartbeater.cc:347] Connected to a master server at 127.19.242.254:46435
I20260808 08:42:42.696470 4626 heartbeater.cc:464] Registering TS with master...
I20260808 08:42:42.697535 4626 heartbeater.cc:511] Master 127.19.242.254:46435 requested a full tablet report, sending...
I20260808 08:42:42.702757 4305 ts_manager.cc:194] Registered new tserver with Master: df31cbb59ac24d3abd24abbfad7b6a92 (127.19.242.193:33255)
I20260808 08:42:42.705034 4305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:50663
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Aug 08 08:42:42 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178562, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
W20260808 08:42:42.780313 20427 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.19.242.194: real 0.119s user 0.003s sys 0.025s
I20260808 08:42:42.781481 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:40885/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46435
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:42:43 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178562, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
W20260808 08:42:43.320482 4634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:42:43.321038 4634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:42:43.321272 4634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:42:43.333662 4634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:42:43.333855 4634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:42:43.334048 4634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:42:43.350562 4634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.242.212:40885/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46435
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:42:43.352784 4634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:42:43.354748 4634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:42:43.376456 4644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:42:43.378173 4645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:42:43.383914 4634 server_base.cc:1034] running on GCE node
W20260808 08:42:43.384393 4651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:42:43.385566 4634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:42:43.387017 4634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:42:43.388373 4634 hybrid_clock.cc:648] HybridClock initialized: now 1786178563388292 us; error 71 us; skew 500 ppm
I20260808 08:42:43.388840 4634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:42:43 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178563, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:42:43.394062 4634 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:42:43.397061 4634 webserver.cc:460] Webserver started at http://127.19.242.194:38859/ using document root <none> and password file <none>
I20260808 08:42:43.398591 4634 fs_manager.cc:359] Metadata directory not provided
I20260808 08:42:43.398826 4634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:42:43.399271 4634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:42:43 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178563, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:42:43.422624 4634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "03e916b5d3784893828ed4ff9faed279"
format_stamp: "Formatted at 2026-08-08 08:42:43 on dist-test-slave-39l8"
server_key: "412dacbb11e36eea85e15e29c54304cf"
server_key_iv: "182006758033b6ca4eff9f67981de4cc"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:43.424088 4634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "03e916b5d3784893828ed4ff9faed279"
format_stamp: "Formatted at 2026-08-08 08:42:43 on dist-test-slave-39l8"
server_key: "412dacbb11e36eea85e15e29c54304cf"
server_key_iv: "182006758033b6ca4eff9f67981de4cc"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:43.433079 4634 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.003s
I20260808 08:42:43.465034 4666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:43.467106 4634 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.006s sys 0.008s
I20260808 08:42:43.467345 4634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "03e916b5d3784893828ed4ff9faed279"
format_stamp: "Formatted at 2026-08-08 08:42:43 on dist-test-slave-39l8"
server_key: "412dacbb11e36eea85e15e29c54304cf"
server_key_iv: "182006758033b6ca4eff9f67981de4cc"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:43.467605 4634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:42:43.484314 4634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:42:43.489311 4634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:42:43.489679 4634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:42:43.490886 4634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:42:43.492820 4634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:42:43.492929 4634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:43.493088 4634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:42:43.493175 4634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:43.535866 4634 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:34873
I20260808 08:42:43.535904 4829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:34873 every 8 connection(s)
I20260808 08:42:43.537336 4634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:42:43.543927 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 4634
I20260808 08:42:43.544145 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:42:43.544667 20427 external_mini_cluster.cc:1428] Setting key 6b0786913bc944c0afcb7403ef692ee5
Aug 08 08:42:43 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178563, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:42:43.565856 4834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:43.540487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:53559 (local address 127.19.242.254:46435)
0808 08:42:43.541102 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:43.541109 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:43.542397 (+ 1288us) server_negotiation.cc:407] Connection header received
0808 08:42:43.545470 (+ 3073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:43.545477 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:43.545608 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:43.545704 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:43.548083 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:43.549416 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:43.552392 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:43.553154 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:43.553323 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:43.558546 (+ 5223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:43.558556 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:43.558564 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:43.558621 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:43.562072 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:43.563148 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:43.563153 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:43.563155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:43.563291 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:43.563805 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:43.563809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:43.563812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:43.564114 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:43.564291 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:43.565142 (+ 851us) server_negotiation.cc:299] Negotiation successful
0808 08:42:43.565418 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":308,"threads_started":1}
I20260808 08:42:43.567209 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:43.541182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:46435 (local address 127.19.242.194:53559)
0808 08:42:43.542156 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:43.542223 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:43.545060 (+ 2837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:43.546194 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:43.546208 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:43.546921 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:42:43.547847 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:43.547875 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:43.549652 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:43.549661 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:43.552118 (+ 2457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:43.552203 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:43.553464 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:43.553472 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:43.553821 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:43.554834 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:42:43.554873 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:42:43.558185 (+ 3312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:42:43.562288 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:42:43.562300 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:42:43.562322 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:42:43.562978 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:42:43.563425 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:42:43.563430 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:42:43.563434 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:42:43.563660 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:42:43.564265 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:42:43.564275 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:42:43.564673 (+ 398us) client_negotiation.cc:769] Sending connection context
0808 08:42:43.565009 (+ 336us) client_negotiation.cc:240] Negotiation successful
0808 08:42:43.565609 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":379,"threads_started":1}
I20260808 08:42:43.570216 4830 heartbeater.cc:347] Connected to a master server at 127.19.242.254:46435
I20260808 08:42:43.570676 4830 heartbeater.cc:464] Registering TS with master...
I20260808 08:42:43.571974 4830 heartbeater.cc:511] Master 127.19.242.254:46435 requested a full tablet report, sending...
I20260808 08:42:43.574920 4305 ts_manager.cc:194] Registered new tserver with Master: 03e916b5d3784893828ed4ff9faed279 (127.19.242.194:34873)
I20260808 08:42:43.575934 4305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:53559
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:42:43.628736 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:40885/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46435
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:42:43.710069 4626 heartbeater.cc:503] Master 127.19.242.254:46435 was elected leader, sending a full tablet report...
W20260808 08:42:44.116340 4838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:42:44.116668 4838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:42:44.116842 4838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:42:44.125571 4838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:42:44.125721 4838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:42:44.125917 4838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:42:44.137236 4838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.242.212:40885/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46435
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:42:44.138921 4838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:42:44.140455 4838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:42:44.157451 4849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:42:44.157639 4846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:42:44.157502 4847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:42:44.158566 4838 server_base.cc:1034] running on GCE node
I20260808 08:42:44.159642 4838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:42:44.160840 4838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:42:44.162142 4838 hybrid_clock.cc:648] HybridClock initialized: now 1786178564162088 us; error 49 us; skew 500 ppm
I20260808 08:42:44.162567 4838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:42:44 dist-test-slave-39l8 krb5kdc[3589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178564, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:42:44.166661 4838 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:42:44.168761 4838 webserver.cc:460] Webserver started at http://127.19.242.195:35391/ using document root <none> and password file <none>
I20260808 08:42:44.169581 4838 fs_manager.cc:359] Metadata directory not provided
I20260808 08:42:44.169749 4838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:42:44.170169 4838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:42:44 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178564, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:42:44.189819 4838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b"
format_stamp: "Formatted at 2026-08-08 08:42:44 on dist-test-slave-39l8"
server_key: "40b1c7d403927d45899cffaf3bb94517"
server_key_iv: "3f7b0326e7e33f2b2793100348ff72fa"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:44.191095 4838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b"
format_stamp: "Formatted at 2026-08-08 08:42:44 on dist-test-slave-39l8"
server_key: "40b1c7d403927d45899cffaf3bb94517"
server_key_iv: "3f7b0326e7e33f2b2793100348ff72fa"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:44.197800 4838 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260808 08:42:44.216033 4865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:44.217639 4838 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:42:44.217875 4838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b"
format_stamp: "Formatted at 2026-08-08 08:42:44 on dist-test-slave-39l8"
server_key: "40b1c7d403927d45899cffaf3bb94517"
server_key_iv: "3f7b0326e7e33f2b2793100348ff72fa"
server_key_version: "kuduclusterkey@0"
I20260808 08:42:44.218148 4838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:42:44.243387 4838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:42:44.248343 4838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:42:44.248775 4838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:42:44.249948 4838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:42:44.251734 4838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:42:44.251852 4838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:44.252031 4838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:42:44.252182 4838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:42:44.301671 4838 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:33651
I20260808 08:42:44.301733 5027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:33651 every 8 connection(s)
I20260808 08:42:44.303253 4838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:42:44.303687 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 4838
I20260808 08:42:44.303895 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:42:44.304613 20427 external_mini_cluster.cc:1428] Setting key 6a9bedfe29b8576fa3b6d58511936f3d
Aug 08 08:42:44 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178564, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:42:44.327553 5032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.306464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:42273 (local address 127.19.242.254:46435)
0808 08:42:44.307073 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.307079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.308846 (+ 1767us) server_negotiation.cc:407] Connection header received
0808 08:42:44.311049 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.311054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.311159 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.311304 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:44.313197 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.313939 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.315733 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.316271 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.316427 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.320345 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:44.320350 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:44.320353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:44.320437 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:44.324145 (+ 3708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.325068 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.325073 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.325075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.325223 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.325719 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.325723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.325726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.326026 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:44.326145 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.327045 (+ 900us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.327276 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":333,"threads_started":1}
I20260808 08:42:44.328806 5033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.307216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:46435 (local address 127.19.242.195:42273)
0808 08:42:44.308683 (+ 1467us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.308733 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.310625 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.311557 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.311567 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.312112 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:42:44.312965 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.312998 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.314103 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.314110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.315539 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.315562 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.316539 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.316547 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.316805 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.317527 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:42:44.317556 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:42:44.320072 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:42:44.324335 (+ 4263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:42:44.324344 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:42:44.324359 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:42:44.324897 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:42:44.325346 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:42:44.325350 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:42:44.325352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:42:44.325604 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:42:44.326175 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:42:44.326182 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:42:44.326542 (+ 360us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.326939 (+ 397us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.327468 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1198,"thread_start_us":542,"threads_started":1}
I20260808 08:42:44.330358 5028 heartbeater.cc:347] Connected to a master server at 127.19.242.254:46435
I20260808 08:42:44.330670 5028 heartbeater.cc:464] Registering TS with master...
I20260808 08:42:44.331604 5028 heartbeater.cc:511] Master 127.19.242.254:46435 requested a full tablet report, sending...
I20260808 08:42:44.333380 4305 ts_manager.cc:194] Registered new tserver with Master: ba672dc4b0ed4e469fc9b58e18b11d5b (127.19.242.195:33651)
I20260808 08:42:44.334461 4305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:42273
I20260808 08:42:44.334617 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:42:44.355633 5032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.340021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53414 (local address 127.19.242.254:46435)
0808 08:42:44.340264 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.340273 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.340899 (+ 626us) server_negotiation.cc:407] Connection header received
0808 08:42:44.341063 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.341067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.341151 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.341241 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:44.343204 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.344021 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.345525 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.345984 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.346093 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.349013 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:44.349020 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:44.349023 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:44.349072 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:44.352169 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.353056 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.353076 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.353078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.353272 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.353723 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.353731 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.353735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.354071 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:44.354441 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.354994 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.355264 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:42:44.361021 4305 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:42:44.369547 4305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:42:44.402407 5051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.386151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46260 (local address 127.19.242.195:33651)
0808 08:42:44.387581 (+ 1430us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.387591 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.388305 (+ 714us) server_negotiation.cc:407] Connection header received
0808 08:42:44.388956 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.388966 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.389337 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.389662 (+ 325us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:42:44.393537 (+ 3875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.395078 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.399153 (+ 4075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.400751 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.400997 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.401217 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.401689 (+ 472us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.401884 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1192,"thread_start_us":940,"threads_started":1}
I20260808 08:42:44.403575 5052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.386519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33651 (local address 127.0.0.1:46260)
0808 08:42:44.388143 (+ 1624us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.388179 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.388416 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.392045 (+ 3629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.392056 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.392111 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:42:44.393097 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.393120 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.395401 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.395408 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.398921 (+ 3513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.398937 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.401110 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.401121 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.401355 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.401430 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.402690 (+ 1260us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.403110 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1265,"thread_start_us":5498,"threads_started":1}
I20260808 08:42:44.404183 5054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.386537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:33255 (local address 127.0.0.1:34038)
0808 08:42:44.392729 (+ 6192us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.392757 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.393416 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.394866 (+ 1450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.394872 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.394902 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:42:44.395571 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.395583 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.398319 (+ 2736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.398325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.400723 (+ 2398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.400739 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.403272 (+ 2533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.403277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.403415 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.403439 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.403573 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.403715 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6026,"mutex_wait_us":48,"thread_start_us":1016,"threads_started":1}
I20260808 08:42:44.404439 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.386196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34038 (local address 127.19.242.193:33255)
0808 08:42:44.388194 (+ 1998us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.388203 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.392929 (+ 4726us) server_negotiation.cc:407] Connection header received
0808 08:42:44.393642 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.393655 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.394060 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.394336 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:42:44.396052 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.398082 (+ 2030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.400926 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.402524 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.402812 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.403008 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.403643 (+ 635us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.403962 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1752,"thread_start_us":1552,"threads_started":1}
I20260808 08:42:44.408648 4531 tablet_service.cc:1467] Processing CreateTablet for tablet 20dde4042a9a4df4a25b78721adebfd6 (DEFAULT_TABLE table=test-table [id=e2b0c18af9f84968ab9693b0ca9bd344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:42:44.408663 4936 tablet_service.cc:1467] Processing CreateTablet for tablet 20dde4042a9a4df4a25b78721adebfd6 (DEFAULT_TABLE table=test-table [id=e2b0c18af9f84968ab9693b0ca9bd344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:42:44.409914 5055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.388709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:34873 (local address 127.0.0.1:60466)
0808 08:42:44.399507 (+ 10798us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.399535 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.399695 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.400457 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.400464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.400510 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:42:44.401299 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.401314 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.404443 (+ 3129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.404448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.406787 (+ 2339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.406805 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.408939 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.408948 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.409146 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.409183 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.409296 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.409446 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10622,"mutex_wait_us":4,"thread_start_us":10422,"threads_started":1}
I20260808 08:42:44.410030 5056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.389150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60466 (local address 127.19.242.194:34873)
0808 08:42:44.393225 (+ 4075us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.393231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.399692 (+ 6461us) server_negotiation.cc:407] Connection header received
0808 08:42:44.399869 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.399879 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.400216 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.400452 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:42:44.401556 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.403819 (+ 2263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.407020 (+ 3201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.408673 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.408922 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.409138 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.409358 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.409664 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3878,"thread_start_us":3760,"threads_started":1}
I20260808 08:42:44.410557 4531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20dde4042a9a4df4a25b78721adebfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:42:44.410571 4936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20dde4042a9a4df4a25b78721adebfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:42:44.415069 4740 tablet_service.cc:1467] Processing CreateTablet for tablet 20dde4042a9a4df4a25b78721adebfd6 (DEFAULT_TABLE table=test-table [id=e2b0c18af9f84968ab9693b0ca9bd344]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:42:44.417037 4740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20dde4042a9a4df4a25b78721adebfd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:42:44.426294 5057 tablet_bootstrap.cc:492] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Bootstrap starting.
I20260808 08:42:44.429557 5061 tablet_bootstrap.cc:492] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Bootstrap starting.
I20260808 08:42:44.432806 5057 tablet_bootstrap.cc:654] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Neither blocks nor log segments found. Creating new log.
I20260808 08:42:44.434536 5057 log.cc:824] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:42:44.435032 5061 tablet_bootstrap.cc:654] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Neither blocks nor log segments found. Creating new log.
I20260808 08:42:44.436894 5061 log.cc:824] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Log is configured to *not* fsync() on all Append() calls
I20260808 08:42:44.436622 5062 tablet_bootstrap.cc:492] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Bootstrap starting.
I20260808 08:42:44.439191 5057 tablet_bootstrap.cc:492] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: No bootstrap required, opened a new log
I20260808 08:42:44.439581 5057 ts_tablet_manager.cc:1397] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260808 08:42:44.441088 5061 tablet_bootstrap.cc:492] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: No bootstrap required, opened a new log
I20260808 08:42:44.441462 5061 ts_tablet_manager.cc:1397] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20260808 08:42:44.446208 5062 tablet_bootstrap.cc:654] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Neither blocks nor log segments found. Creating new log.
I20260808 08:42:44.447549 5062 log.cc:824] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Log is configured to *not* fsync() on all Append() calls
I20260808 08:42:44.450927 5062 tablet_bootstrap.cc:492] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: No bootstrap required, opened a new log
I20260808 08:42:44.451311 5062 ts_tablet_manager.cc:1397] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.006s
I20260808 08:42:44.454401 5057 raft_consensus.cc:348] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.455017 5057 raft_consensus.cc:374] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:42:44.455174 5057 raft_consensus.cc:729] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba672dc4b0ed4e469fc9b58e18b11d5b, State: Initialized, Role: FOLLOWER
I20260808 08:42:44.455690 5061 raft_consensus.cc:348] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.456396 5061 raft_consensus.cc:374] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:42:44.456032 5057 consensus_queue.cc:260] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.456583 5061 raft_consensus.cc:729] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df31cbb59ac24d3abd24abbfad7b6a92, State: Initialized, Role: FOLLOWER
I20260808 08:42:44.457803 5061 consensus_queue.cc:260] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.458582 5028 heartbeater.cc:503] Master 127.19.242.254:46435 was elected leader, sending a full tablet report...
I20260808 08:42:44.461733 5061 ts_tablet_manager.cc:1428] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Time spent starting tablet: real 0.020s user 0.021s sys 0.000s
I20260808 08:42:44.461800 5062 raft_consensus.cc:348] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.462427 5062 raft_consensus.cc:374] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:42:44.462502 5057 ts_tablet_manager.cc:1428] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Time spent starting tablet: real 0.023s user 0.021s sys 0.000s
I20260808 08:42:44.462586 5062 raft_consensus.cc:729] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03e916b5d3784893828ed4ff9faed279, State: Initialized, Role: FOLLOWER
I20260808 08:42:44.463500 5062 consensus_queue.cc:260] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.468835 4830 heartbeater.cc:503] Master 127.19.242.254:46435 was elected leader, sending a full tablet report...
I20260808 08:42:44.469655 5062 ts_tablet_manager.cc:1428] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260808 08:42:44.489498 5067 raft_consensus.cc:482] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:42:44.489954 5067 raft_consensus.cc:504] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.492142 5067 leader_election.cc:288] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df31cbb59ac24d3abd24abbfad7b6a92 (127.19.242.193:33255), 03e916b5d3784893828ed4ff9faed279 (127.19.242.194:34873)
I20260808 08:42:44.494297 5069 raft_consensus.cc:482] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:42:44.494892 5069 raft_consensus.cc:504] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.497443 5069 leader_election.cc:288] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df31cbb59ac24d3abd24abbfad7b6a92 (127.19.242.193:33255), ba672dc4b0ed4e469fc9b58e18b11d5b (127.19.242.195:33651)
I20260808 08:42:44.502061 5033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.492699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:33255 (local address 127.19.242.195:55977)
0808 08:42:44.493439 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.493460 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.493589 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.494232 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.494239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.494274 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:42:44.494762 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.494778 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.496244 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.496250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.498320 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.498346 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.500369 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.500376 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.500584 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.500620 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.500722 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.500876 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618}
I20260808 08:42:44.502159 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.492869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:55977 (local address 127.19.242.193:33255)
0808 08:42:44.493137 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.493146 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.493733 (+ 587us) server_negotiation.cc:407] Connection header received
0808 08:42:44.493822 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.493827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.493902 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.493995 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:42:44.494947 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.496077 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.498588 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.499976 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.500185 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.500273 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.501349 (+ 1076us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.501597 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:42:44.503005 5056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.493730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:54039 (local address 127.19.242.194:34873)
0808 08:42:44.494138 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.494143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.495016 (+ 873us) server_negotiation.cc:407] Connection header received
0808 08:42:44.495226 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.495231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.495357 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.495468 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:42:44.496072 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.497333 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.500222 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.501572 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.501718 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.501797 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.502479 (+ 682us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.502658 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226}
I20260808 08:42:44.503827 5070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.493175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:34873 (local address 127.19.242.195:54039)
0808 08:42:44.494903 (+ 1728us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.494922 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.495068 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.495486 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.495491 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.495513 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:42:44.495895 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.495903 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.497752 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.497756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.499976 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.499994 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.502010 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.502019 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.502253 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.502301 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.503273 (+ 972us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.503425 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1578,"mutex_wait_us":1,"thread_start_us":1298,"threads_started":1}
I20260808 08:42:44.505002 4766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20dde4042a9a4df4a25b78721adebfd6" candidate_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e916b5d3784893828ed4ff9faed279" is_pre_election: true
I20260808 08:42:44.505555 4766 raft_consensus.cc:2454] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba672dc4b0ed4e469fc9b58e18b11d5b in term 0.
I20260808 08:42:44.506523 4873 leader_election.cc:302] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e916b5d3784893828ed4ff9faed279, ba672dc4b0ed4e469fc9b58e18b11d5b; no voters:
I20260808 08:42:44.507135 5067 raft_consensus.cc:2781] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:42:44.507330 5067 raft_consensus.cc:482] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:42:44.507481 5067 raft_consensus.cc:3037] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:42:44.509173 5051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.497600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:41163 (local address 127.19.242.195:33651)
0808 08:42:44.497811 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.497821 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.499301 (+ 1480us) server_negotiation.cc:407] Connection header received
0808 08:42:44.499609 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.499619 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.499717 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.499793 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:42:44.500940 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.502230 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.505661 (+ 3431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.507622 (+ 1961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.507809 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.507925 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.508728 (+ 803us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.508891 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:42:44.509990 5071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.497231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33651 (local address 127.19.242.194:41163)
0808 08:42:44.499168 (+ 1937us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.499190 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.499426 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.500055 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.500063 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.500098 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:42:44.500704 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.500719 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.502465 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.502471 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.505398 (+ 2927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.505424 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.508204 (+ 2780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.508214 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.508489 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.508545 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.508677 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.508890 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1799,"mutex_wait_us":391,"thread_start_us":631,"threads_started":1}
I20260808 08:42:44.510236 4561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20dde4042a9a4df4a25b78721adebfd6" candidate_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" is_pre_election: true
I20260808 08:42:44.510792 5067 raft_consensus.cc:504] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.510933 4561 raft_consensus.cc:2454] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba672dc4b0ed4e469fc9b58e18b11d5b in term 0.
I20260808 08:42:44.511588 5067 leader_election.cc:288] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [CANDIDATE]: Term 1 election: Requested vote from peers df31cbb59ac24d3abd24abbfad7b6a92 (127.19.242.193:33255), 03e916b5d3784893828ed4ff9faed279 (127.19.242.194:34873)
I20260808 08:42:44.512369 4766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20dde4042a9a4df4a25b78721adebfd6" candidate_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03e916b5d3784893828ed4ff9faed279"
I20260808 08:42:44.512364 4964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20dde4042a9a4df4a25b78721adebfd6" candidate_uuid: "03e916b5d3784893828ed4ff9faed279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" is_pre_election: true
I20260808 08:42:44.512617 4766 raft_consensus.cc:3037] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:42:44.512954 4964 raft_consensus.cc:2379] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03e916b5d3784893828ed4ff9faed279 in current term 1: Already voted for candidate ba672dc4b0ed4e469fc9b58e18b11d5b in this term.
I20260808 08:42:44.513847 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.498008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:41325 (local address 127.19.242.193:33255)
0808 08:42:44.503484 (+ 5476us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.503490 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.503510 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:42:44.503581 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.503586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.503684 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.503786 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:42:44.504783 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.505924 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.511147 (+ 5223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.512474 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.512663 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.512739 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.513366 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.513520 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5368,"thread_start_us":11100,"threads_started":1}
I20260808 08:42:44.513929 5073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.497224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:33255 (local address 127.19.242.194:41325)
0808 08:42:44.498447 (+ 1223us) negotiation.cc:107] Waiting for socket to connect
0808 08:42:44.498473 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:42:44.498620 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:42:44.504078 (+ 5458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:42:44.504086 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:42:44.504119 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:42:44.504557 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.504577 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.506115 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.506121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.510881 (+ 4760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:42:44.510904 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.512915 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.512924 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:42:44.513134 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.513187 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:42:44.513315 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 08:42:44.513477 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1047,"thread_start_us":1645,"threads_started":1}
I20260808 08:42:44.514487 4561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20dde4042a9a4df4a25b78721adebfd6" candidate_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df31cbb59ac24d3abd24abbfad7b6a92"
I20260808 08:42:44.514771 4561 raft_consensus.cc:3037] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:42:44.514729 4560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20dde4042a9a4df4a25b78721adebfd6" candidate_uuid: "03e916b5d3784893828ed4ff9faed279" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" is_pre_election: true
I20260808 08:42:44.515738 4670 leader_election.cc:302] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03e916b5d3784893828ed4ff9faed279; no voters: ba672dc4b0ed4e469fc9b58e18b11d5b, df31cbb59ac24d3abd24abbfad7b6a92
I20260808 08:42:44.516479 4766 raft_consensus.cc:2454] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba672dc4b0ed4e469fc9b58e18b11d5b in term 1.
I20260808 08:42:44.516752 5069 raft_consensus.cc:2726] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 08:42:44.517225 4873 leader_election.cc:302] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03e916b5d3784893828ed4ff9faed279, ba672dc4b0ed4e469fc9b58e18b11d5b; no voters:
I20260808 08:42:44.517596 5067 raft_consensus.cc:2781] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:42:44.518220 5067 raft_consensus.cc:686] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 1 LEADER]: Becoming Leader. State: Replica: ba672dc4b0ed4e469fc9b58e18b11d5b, State: Running, Role: LEADER
I20260808 08:42:44.519412 4561 raft_consensus.cc:2454] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba672dc4b0ed4e469fc9b58e18b11d5b in term 1.
I20260808 08:42:44.519341 5067 consensus_queue.cc:237] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } }
I20260808 08:42:44.524838 4305 catalog_manager.cc:5495] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b reported cstate change: term changed from 0 to 1, leader changed from <none> to ba672dc4b0ed4e469fc9b58e18b11d5b (127.19.242.195). New cstate: current_term: 1 leader_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba672dc4b0ed4e469fc9b58e18b11d5b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 } health_report { overall_health: UNKNOWN } } }
W20260808 08:42:44.539927 4831 tablet.cc:2369] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:42:44.555382 5029 tablet.cc:2369] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:42:44.563182 5051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.556964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46270 (local address 127.19.242.195:33651)
0808 08:42:44.557156 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.557161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.557359 (+ 198us) server_negotiation.cc:407] Connection header received
0808 08:42:44.557547 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.557551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.557641 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.557789 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:42:44.558163 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.559144 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.560865 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.561327 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.561441 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.562008 (+ 567us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:42:44.562571 (+ 563us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:42:44.562692 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.562861 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.562941 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:42:44.572836 4561 raft_consensus.cc:1261] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 1 FOLLOWER]: Refusing update from remote peer ba672dc4b0ed4e469fc9b58e18b11d5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:42:44.572876 4766 raft_consensus.cc:1261] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 1 FOLLOWER]: Refusing update from remote peer ba672dc4b0ed4e469fc9b58e18b11d5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:42:44.573910 5078 consensus_queue.cc:1035] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03e916b5d3784893828ed4ff9faed279" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 34873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:42:44.574388 5067 consensus_queue.cc:1035] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df31cbb59ac24d3abd24abbfad7b6a92" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:42:44.608784 4305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:42:44.609097 4305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:42:44.613580 4305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79acaf35015b4c6587488b9cb7da4927: Sending DeleteTablet for 3 replicas of tablet 20dde4042a9a4df4a25b78721adebfd6
I20260808 08:42:44.615024 4936 tablet_service.cc:1514] Processing DeleteTablet for tablet 20dde4042a9a4df4a25b78721adebfd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:42:44 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:46260
I20260808 08:42:44.615258 4740 tablet_service.cc:1514] Processing DeleteTablet for tablet 20dde4042a9a4df4a25b78721adebfd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:42:44 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:60466
I20260808 08:42:44.615983 4531 tablet_service.cc:1514] Processing DeleteTablet for tablet 20dde4042a9a4df4a25b78721adebfd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:42:44 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:34038
I20260808 08:42:44.619668 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 4428
I20260808 08:42:44.639726 5106 tablet_replica.cc:330] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: stopping tablet replica
I20260808 08:42:44.640439 5106 raft_consensus.cc:2229] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:42:44.641197 5106 raft_consensus.cc:2258] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:42:44.642556 5103 tablet_replica.cc:330] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: stopping tablet replica
I20260808 08:42:44.643217 5103 raft_consensus.cc:2229] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:42:44.644300 5103 raft_consensus.cc:2258] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:42:44.646209 5105 tablet_replica.cc:330] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: stopping tablet replica
I20260808 08:42:44.646696 5105 raft_consensus.cc:2229] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:42:44.647284 5105 raft_consensus.cc:2258] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:42:44.647570 5106 ts_tablet_manager.cc:1905] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:42:44.648056 5103 ts_tablet_manager.cc:1905] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:42:44.655750 5106 ts_tablet_manager.cc:1918] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:42:44.655969 5106 log.cc:1196] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/20dde4042a9a4df4a25b78721adebfd6
I20260808 08:42:44.656292 5103 ts_tablet_manager.cc:1918] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:42:44.656499 5106 ts_tablet_manager.cc:1939] T 20dde4042a9a4df4a25b78721adebfd6 P df31cbb59ac24d3abd24abbfad7b6a92: Deleting consensus metadata
I20260808 08:42:44.656535 5103 log.cc:1196] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/20dde4042a9a4df4a25b78721adebfd6
I20260808 08:42:44.657145 5103 ts_tablet_manager.cc:1939] T 20dde4042a9a4df4a25b78721adebfd6 P ba672dc4b0ed4e469fc9b58e18b11d5b: Deleting consensus metadata
I20260808 08:42:44.659269 4280 catalog_manager.cc:4841] TS df31cbb59ac24d3abd24abbfad7b6a92 (127.19.242.193:33255): tablet 20dde4042a9a4df4a25b78721adebfd6 (table test-table [id=e2b0c18af9f84968ab9693b0ca9bd344]) successfully deleted
I20260808 08:42:44.662354 5105 ts_tablet_manager.cc:1905] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:42:44.670548 5105 ts_tablet_manager.cc:1918] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:42:44.671033 5105 log.cc:1196] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/20dde4042a9a4df4a25b78721adebfd6
Aug 08 08:42:44 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:42:44.671756 5105 ts_tablet_manager.cc:1939] T 20dde4042a9a4df4a25b78721adebfd6 P 03e916b5d3784893828ed4ff9faed279: Deleting consensus metadata
I20260808 08:42:44.672569 4278 catalog_manager.cc:4841] TS ba672dc4b0ed4e469fc9b58e18b11d5b (127.19.242.195:33651): tablet 20dde4042a9a4df4a25b78721adebfd6 (table test-table [id=e2b0c18af9f84968ab9693b0ca9bd344]) successfully deleted
I20260808 08:42:44.673738 4280 catalog_manager.cc:4841] TS 03e916b5d3784893828ed4ff9faed279 (127.19.242.194:34873): tablet 20dde4042a9a4df4a25b78721adebfd6 (table test-table [id=e2b0c18af9f84968ab9693b0ca9bd344]) successfully deleted
I20260808 08:42:44.681505 5050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.620887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34052 (local address 127.19.242.193:33255)
0808 08:42:44.621087 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.621094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.645633 (+ 24539us) server_negotiation.cc:407] Connection header received
0808 08:42:44.658929 (+ 13296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.658935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.659071 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.659173 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:44.661622 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.662908 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.665265 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.666169 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.666288 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.674424 (+ 8136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:44.674442 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:44.674457 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:44.674502 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:44.678075 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.679167 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.679178 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.679180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.679395 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.679868 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.679872 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.679874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.680286 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:44.680576 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.680991 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.681194 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:42:44.682279 4618 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:42:44.784165 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 4428
I20260808 08:42:44.813226 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 4634
Aug 08 08:42:44 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:42:44.832505 5056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.814106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60480 (local address 127.19.242.194:34873)
0808 08:42:44.814318 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.814323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.814451 (+ 128us) server_negotiation.cc:407] Connection header received
0808 08:42:44.814656 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.814660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.814800 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.814888 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:44.816709 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.817494 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.819601 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.820037 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.820149 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.826058 (+ 5909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:44.826077 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:44.826096 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:44.826145 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:44.829299 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.830279 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.830287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.830289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.830418 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.830927 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.830930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.830932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.831335 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:44.831589 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.831972 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.832165 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:42:44.833187 4821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:42:44.947146 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 4634
I20260808 08:42:44.974471 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 4838
Aug 08 08:42:44 dist-test-slave-39l8 krb5kdc[3589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:42:44.995189 5051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:42:44.975537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46284 (local address 127.19.242.195:33651)
0808 08:42:44.975793 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 08:42:44.975798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:42:44.975820 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:42:44.976022 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:42:44.976028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:42:44.976173 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:42:44.976318 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:42:44.978374 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.979363 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.981437 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:42:44.981900 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:42:44.982013 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:42:44.988450 (+ 6437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:42:44.988467 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:42:44.988484 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:42:44.988528 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:42:44.991940 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.992812 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.992820 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.992823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.992957 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:42:44.993384 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:42:44.993396 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:42:44.993399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:42:44.993845 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:42:44.994217 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 08:42:44.994542 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 08:42:44.994833 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:42:44.995937 5018 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:42:45.123371 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 4838
I20260808 08:42:45.150878 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 4249
I20260808 08:42:45.152243 4350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:42:45.267876 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 4249
I20260808 08:42:45.302350 20427 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:42:45.649304 20427 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:42:45.649573 20427 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:42:46.006632 20427 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:42:46.007 UTC [3629] LOG: received smart shutdown request
2026-08-08 08:42:46.011 UTC [3629] LOG: background worker "logical replication launcher" (PID 3643) exited with exit code 1
2026-08-08 08:42:46.011 UTC [3635] LOG: shutting down
2026-08-08 08:42:46.192 UTC [3629] LOG: database system is shut down
2026-08-08T08:42:46Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54479 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:42:46 dist-test-slave-39l8 krb5kdc[5128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:42:46 dist-test-slave-39l8 krb5kdc[5128](info): set up 2 sockets
Aug 08 08:42:46 dist-test-slave-39l8 krb5kdc[5128](info): commencing operation
krb5kdc: starting...
W20260808 08:42:47.690815 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:42:47 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:42:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:42:47Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/rangeradmin_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/rangeradmin_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/rangerlookup_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/rangerlookup_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
I20260808 08:42:48.137437 20427 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskkvSB7S/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/postgres -l logfile start
2026-08-08 08:42:50.745 UTC [5172] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:42:50.745 UTC [5172] LOG: listening on IPv4 address "127.19.242.212", port 42197
2026-08-08 08:42:50.749 UTC [5172] LOG: listening on Unix socket "/tmp/.s.PGSQL.42197"
2026-08-08 08:42:50.772 UTC [5175] LOG: database system was shut down at 2026-08-08 08:42:49 UTC
2026-08-08 08:42:50.776 UTC [5172] LOG: database system is ready to accept connections
I20260808 08:42:51.968529 20427 mini_postgres.cc:96] Postgres bound to 42197
2026-08-08 08:42:51.994 UTC [5188] FATAL: database "slave" does not exist
127.19.242.212:42197 - accepting connections
I20260808 08:42:51.994905 20427 mini_ranger.cc:161] Starting Ranger...
I20260808 08:42:52.034204 20427 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:42:52.543220 20427 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:42:52.543332 20427 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-admin
2026-08-08 08:42:52,852 [I] DB FLAVOR :POSTGRES
2026-08-08 08:42:52,852 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:42:52,852 [I] Checking connection..
2026-08-08 08:42:52,852 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:42:53,136 [I] Checking connection passed.
2026-08-08 08:42:53,136 [I] --------- Verifying version history table ---------
2026-08-08 08:42:53,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:42:53,421 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:42:53,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:42:53,707 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:42:53,707 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:42:53,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:42:53.978 UTC [5283] WARNING: there is no transaction in progress
2026-08-08 08:42:53,988 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:42:53,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:42:54,282 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:42:54,283 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:42:54,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:42:54,543 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:42:54,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-39l8.c.gcp-upstream.internal','N') ;"
2026-08-08 08:42:55,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:42:55,373 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:42:55,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:42:55,659 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:42:55,659 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:42:55,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:42:56,195 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:42:56,196 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:42:57.294 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.313 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.332 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.350 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.368 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.389 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.453 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.461 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.477 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.489 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.502 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.518 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.531 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.538 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.545 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:57.553 UTC [5442] WARNING: there is no transaction in progress
2026-08-08 08:42:58,274 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:42:58,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:42:58,546 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:42:58,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:42:58,839 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:42:58,840 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:42:59,116 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:42:59,116 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:42:59,376 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:42:59,657 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-39l8.c.gcp-upstream.internal';"
2026-08-08 08:42:59,925 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:42:59,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:43:00,207 [I] DB_PATCHES have already been applied
I20260808 08:43:00.213961 20427 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-admin:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskkvSB7S/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:43:00.214062 20427 mini_ranger.cc:193] Using host: 127.19.242.212
I20260808 08:43:00.236908 20427 mini_ranger.cc:227] Ranger admin URL: http://127.19.242.212:40639
Aug 08, 2026 8:43:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:43:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:43:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:43:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:43:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:43:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:43:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:43:01.690354 20427 mini_ranger.cc:160] Time spent starting Ranger: real 9.695s user 0.003s sys 0.068s
Aug 08, 2026 8:43:24 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:43:24 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 08, 2026 8:43:24 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:43:24 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:43:25 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:43:25.792610 20427 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.242.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.242.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/rangerkms_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.242.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/rangerkms_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.242.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.242.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.242.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/HTTP_127.19.242.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:43:26 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178606, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:43:26.018954 20427 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:43:26.049968 20427 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:43:27.011693 20427 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:43:27.011819 20427 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms
I20260808 08:43:27.011865 20427 mini_ranger_kms.cc:227] Using postgres at 127.19.242.212:42197
2026-08-08 08:43:27,393 [I] DB FLAVOR :POSTGRES
2026-08-08 08:43:27,393 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:43:27,393 [I] Checking connection
2026-08-08 08:43:27,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:43:27,679 [I] connection success
2026-08-08 08:43:27,679 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:43:27,679 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:43:27,679 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:43:27,932 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:43:27,933 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:43:27,933 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:43:27,933 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.242.212:42197/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:43:28,246 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:43:28.769073 20427 mini_ranger_kms.cc:310] Created kms service
I20260808 08:43:28.966889 20427 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:43:29.021318 20427 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:43:29 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178606, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:29.482241 20427 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:43:29.482640 20427 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms:/tmp/dist-test-taskkvSB7S/build/asan/bin/postgresql.jar:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskkvSB7S/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:43:29.482761 20427 mini_ranger_kms.cc:240] Using host: 127.19.242.212
I20260808 08:43:29.505367 20427 mini_ranger_kms.cc:276] Ranger KMS PID: 5714
I20260808 08:43:29.505522 20427 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.242.212:53629
Aug 08, 2026 8:43:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:43:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:43:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:43:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:43:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:43:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 08:43:31 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178611, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.242.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:32.318123 20427 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.299s user 0.102s sys 0.318s
I20260808 08:43:32.318403 20427 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:43:32.318619 20427 mini_ranger_kms.cc:401] 127.19.242.212:53629/kms/v1/keys
Aug 08 08:43:32 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178611, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.242.212@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
Aug 08 08:43:32 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178611, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.242.212@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
Aug 08 08:43:35 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:43:35.216483 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37935
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:37935
--ranger_config_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:35.586501 5779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:35.586954 5779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:35.587113 5779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:35.595342 5779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:35.595510 5779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:35.595610 5779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:35.595711 5779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:35.595784 5779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:35.607079 5779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.242.212:53629/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:37935
--ranger_config_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:35.608541 5779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:35.609965 5779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:35.622952 5786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:35.623008 5789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:35.623160 5785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:35.623859 5779 server_base.cc:1034] running on GCE node
I20260808 08:43:35.624804 5779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:35.626507 5779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:35.627782 5779 hybrid_clock.cc:648] HybridClock initialized: now 1786178615627726 us; error 48 us; skew 500 ppm
I20260808 08:43:35.628191 5779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:35 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:35.631970 5779 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:43:35.633857 5779 webserver.cc:460] Webserver started at http://127.19.242.254:40181/ using document root <none> and password file <none>
I20260808 08:43:35.634603 5779 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:35.634797 5779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:35.635155 5779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:43:35 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:35.700634 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "92fe976957154c15b3a7ec84f7764a05"
format_stamp: "Formatted at 2026-08-08 08:43:35 on dist-test-slave-39l8"
server_key: "0d62e0256be669ec82144db31c0dfc6e"
server_key_iv: "dfd16ede7439dfff23173e9d4ec9e8fb"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:35.701710 5779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "92fe976957154c15b3a7ec84f7764a05"
format_stamp: "Formatted at 2026-08-08 08:43:35 on dist-test-slave-39l8"
server_key: "0d62e0256be669ec82144db31c0dfc6e"
server_key_iv: "dfd16ede7439dfff23173e9d4ec9e8fb"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:35.707893 5779 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 08:43:35.725701 5799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:35.727478 5779 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:35.727713 5779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "92fe976957154c15b3a7ec84f7764a05"
format_stamp: "Formatted at 2026-08-08 08:43:35 on dist-test-slave-39l8"
server_key: "0d62e0256be669ec82144db31c0dfc6e"
server_key_iv: "dfd16ede7439dfff23173e9d4ec9e8fb"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:35.727967 5779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:35.748375 5779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:35.752635 5779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:35.752980 5779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:35.773201 5779 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:37935
I20260808 08:43:35.773227 5879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:37935 every 8 connection(s)
I20260808 08:43:35.774765 5779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:43:35.779019 5880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:35.783155 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 5779
I20260808 08:43:35.783396 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:43:35.784153 20427 external_mini_cluster.cc:1428] Setting key 2748ca0f41cc43c6a83e67993627d644
I20260808 08:43:35.792536 5880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Bootstrap starting.
I20260808 08:43:35.796582 5880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:35.798105 5880 log.cc:824] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:35.801693 5880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: No bootstrap required, opened a new log
Aug 08 08:43:35 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:35.811344 5883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:35.786485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54130 (local address 127.19.242.254:37935)
0808 08:43:35.787479 (+ 994us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:35.787503 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:35.787566 (+ 63us) server_negotiation.cc:407] Connection header received
0808 08:43:35.790522 (+ 2956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:35.790561 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:35.791200 (+ 639us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:35.791720 (+ 520us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:35.793143 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:35.795214 (+ 2071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:35.796641 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:35.797783 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:35.798012 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:35.803239 (+ 5227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:35.803248 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:35.803266 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:35.803313 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:35.806520 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:35.807553 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:35.807561 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:35.807568 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:35.807761 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:35.808217 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:35.808221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:35.808223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:35.808889 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:35.809150 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:35.809642 (+ 492us) server_negotiation.cc:299] Negotiation successful
0808 08:43:35.810069 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":432,"threads_started":1}
I20260808 08:43:35.811636 5880 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:35.812094 5880 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:35.812229 5880 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fe976957154c15b3a7ec84f7764a05, State: Initialized, Role: FOLLOWER
I20260808 08:43:35.812867 5880 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:35.813141 5880 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:43:35.813301 5880 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:43:35.813496 5880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:35.816164 5880 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:35.816709 5880 leader_election.cc:302] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92fe976957154c15b3a7ec84f7764a05; no voters:
I20260808 08:43:35.817405 5880 leader_election.cc:288] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:43:35.817557 5885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:43:35.818298 5885 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 LEADER]: Becoming Leader. State: Replica: 92fe976957154c15b3a7ec84f7764a05, State: Running, Role: LEADER
I20260808 08:43:35.818898 5885 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:35.819693 5880 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:43:35.822686 5886 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92fe976957154c15b3a7ec84f7764a05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } } }
I20260808 08:43:35.822607 5887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92fe976957154c15b3a7ec84f7764a05. Latest consensus state: current_term: 1 leader_uuid: "92fe976957154c15b3a7ec84f7764a05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } } }
I20260808 08:43:35.823316 5886 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:35.823352 5887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:35.828197 5900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:43:35.833460 5900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:43:35.834336 5880 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:43:35.856230 5900 catalog_manager.cc:1347] Generated new cluster ID: 37e54cf285a94fd382df8bc4035d2069
I20260808 08:43:35.856529 5900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:43:35.901036 5900 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:43:35.903237 5900 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:43:35.918988 5900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Generated new TSK 0
I20260808 08:43:35.920377 5900 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:43:36.710778 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37935
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:43:37 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:43:37.251209 5945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:37.251796 5945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:37.252053 5945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:37.265941 5945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:37.266167 5945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:37.266415 5945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:43:37.285327 5945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.242.212:53629/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:37.287487 5945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:37.289563 5945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:37.307883 5960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:37.308143 5961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:37.311151 5963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:37.313449 5945 server_base.cc:1034] running on GCE node
I20260808 08:43:37.314427 5945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:37.315907 5945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:37.317183 5945 hybrid_clock.cc:648] HybridClock initialized: now 1786178617317105 us; error 76 us; skew 500 ppm
I20260808 08:43:37.317637 5945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:37 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:37.326690 5945 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:43:37.330171 5945 webserver.cc:460] Webserver started at http://127.19.242.193:37997/ using document root <none> and password file <none>
I20260808 08:43:37.331209 5945 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:37.331590 5945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:37.332093 5945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:43:37 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:37.351643 5945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "84494bae45d84ae586311d9331f6ea3e"
format_stamp: "Formatted at 2026-08-08 08:43:37 on dist-test-slave-39l8"
server_key: "e4810c8bb8daf97de6cc79666c1afd32"
server_key_iv: "49ef82487f06c81f16850decf27a38da"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:37.352782 5945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "84494bae45d84ae586311d9331f6ea3e"
format_stamp: "Formatted at 2026-08-08 08:43:37 on dist-test-slave-39l8"
server_key: "e4810c8bb8daf97de6cc79666c1afd32"
server_key_iv: "49ef82487f06c81f16850decf27a38da"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:37.359400 5945 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 08:43:37.395351 5973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:37.397971 5945 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.008s sys 0.004s
I20260808 08:43:37.398337 5945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "84494bae45d84ae586311d9331f6ea3e"
format_stamp: "Formatted at 2026-08-08 08:43:37 on dist-test-slave-39l8"
server_key: "e4810c8bb8daf97de6cc79666c1afd32"
server_key_iv: "49ef82487f06c81f16850decf27a38da"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:37.398789 5945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:37.436322 5945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:37.445075 5945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:37.445569 5945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:37.447084 5945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:37.449536 5945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:37.449771 5945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 08:43:37.450007 5945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:37.450142 5945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:37.532889 5945 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:34637
I20260808 08:43:37.532930 6126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:34637 every 8 connection(s)
I20260808 08:43:37.534839 5945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:43:37.536191 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 5945
I20260808 08:43:37.536478 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:43:37.537551 20427 external_mini_cluster.cc:1428] Setting key ceab26a192f0d357cce6534c4630d718
Aug 08 08:43:37 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:37.609043 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:37.557330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:57207 (local address 127.19.242.254:37935)
0808 08:43:37.576128 (+ 18798us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:37.576135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:37.576162 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:43:37.576246 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:37.576251 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:37.576367 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:37.576503 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:37.585815 (+ 9312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:37.587171 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:37.589831 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:37.590679 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:37.590880 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:37.599291 (+ 8411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:37.599309 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:37.599334 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:37.599402 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:37.603832 (+ 4430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:37.605245 (+ 1413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:37.605256 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:37.605262 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:37.605498 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:37.606410 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:37.606418 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:37.606425 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:37.607084 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:37.607319 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:37.608339 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0808 08:43:37.608620 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18606,"thread_start_us":19310,"threads_started":1}
I20260808 08:43:37.610375 6131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:37.558215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37935 (local address 127.19.242.193:57207)
0808 08:43:37.570427 (+ 12212us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:37.570516 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:37.573280 (+ 2764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:37.583541 (+ 10261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:37.583560 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:37.584364 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:37.585415 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:37.585452 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:37.587389 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:37.587395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:37.589602 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:37.589636 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:37.593804 (+ 4168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:37.593816 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:37.594183 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:37.595102 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:37.595142 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:37.598556 (+ 3414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:37.604098 (+ 5542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:37.604113 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:37.604139 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:37.605048 (+ 909us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:37.605799 (+ 751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:37.605805 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:37.605808 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:37.606255 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:37.607254 (+ 999us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:37.607264 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:37.607822 (+ 558us) client_negotiation.cc:769] Sending connection context
0808 08:43:37.608197 (+ 375us) client_negotiation.cc:240] Negotiation successful
0808 08:43:37.608838 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11613,"thread_start_us":15411,"threads_started":1}
I20260808 08:43:37.612751 6127 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37935
I20260808 08:43:37.613106 6127 heartbeater.cc:464] Registering TS with master...
Aug 08 08:43:37 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:37.614097 6127 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
I20260808 08:43:37.617131 5827 ts_manager.cc:194] Registered new tserver with Master: 84494bae45d84ae586311d9331f6ea3e (127.19.242.193:34637)
I20260808 08:43:37.619513 5827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:57207
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
W20260808 08:43:37.674333 20427 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.19.242.194: real 0.133s user 0.003s sys 0.024s
I20260808 08:43:37.675344 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37935
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:43:37 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
W20260808 08:43:38.205255 6136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:38.205734 6136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:38.205907 6136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:38.219393 6136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:38.219591 6136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:38.219807 6136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:43:38.238281 6136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.242.212:53629/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:38.240377 6136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:38.242442 6136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:38.261693 6157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:38.262385 6154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:38.262452 6160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:38.263520 6136 server_base.cc:1034] running on GCE node
I20260808 08:43:38.264501 6136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:38.265947 6136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:38.267230 6136 hybrid_clock.cc:648] HybridClock initialized: now 1786178618267095 us; error 118 us; skew 500 ppm
I20260808 08:43:38.267680 6136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:38 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:38.272545 6136 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:43:38.274673 6136 webserver.cc:460] Webserver started at http://127.19.242.194:36145/ using document root <none> and password file <none>
I20260808 08:43:38.275796 6136 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:38.275986 6136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:38.276424 6136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:43:38 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:38.295365 6136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "3cdfbe40874149968b51e5c2d8be890f"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "a6eaf182ed520cc491716937628dbd5f"
server_key_iv: "fd3db8a66d61681202b87bb272f6963b"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:38.296605 6136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "3cdfbe40874149968b51e5c2d8be890f"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "a6eaf182ed520cc491716937628dbd5f"
server_key_iv: "fd3db8a66d61681202b87bb272f6963b"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:38.303642 6136 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:43:38.322199 6171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:38.324239 6136 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:38.324450 6136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "3cdfbe40874149968b51e5c2d8be890f"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "a6eaf182ed520cc491716937628dbd5f"
server_key_iv: "fd3db8a66d61681202b87bb272f6963b"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:38.324736 6136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:38.345635 6136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:38.351176 6136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:38.351523 6136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:38.352778 6136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:38.354784 6136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:38.354912 6136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 08:43:38.355135 6136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:38.355225 6136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:38.397555 6136 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:43667
I20260808 08:43:38.397606 6338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:43667 every 8 connection(s)
I20260808 08:43:38.399401 6136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:43:38.404798 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 6136
I20260808 08:43:38.405017 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:43:38.405661 20427 external_mini_cluster.cc:1428] Setting key 8cc0dba8c77826eebb5b431d48a79775
Aug 08 08:43:38 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:38.424530 6342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:38.402631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:50809 (local address 127.19.242.254:37935)
0808 08:43:38.403293 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:38.403298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:38.406798 (+ 3500us) server_negotiation.cc:407] Connection header received
0808 08:43:38.407455 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:38.407461 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:38.407549 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:38.407675 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:38.409486 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:38.410294 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:38.412212 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:38.412703 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:38.412864 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:38.416830 (+ 3966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:38.416836 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:38.416840 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:38.416881 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:38.420142 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:38.421196 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:38.421204 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:38.421208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:38.421362 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:38.422086 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:38.422092 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:38.422095 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:38.422578 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:38.422786 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:38.423881 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0808 08:43:38.424134 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":383,"threads_started":1}
I20260808 08:43:38.426502 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:38.403313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37935 (local address 127.19.242.194:50809)
0808 08:43:38.404239 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:38.404334 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:38.407075 (+ 2741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:38.408017 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:38.408032 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:38.408592 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:38.409280 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:38.409301 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:38.410486 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:38.410491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:38.412033 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:38.412049 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:38.412978 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:38.412986 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:38.413276 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:38.414067 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:38.414101 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:38.416529 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:38.420312 (+ 3783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:38.420323 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:38.420345 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:38.421042 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:38.421559 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:38.421568 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:38.421574 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:38.421891 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:38.422796 (+ 905us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:38.422807 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:38.423381 (+ 574us) client_negotiation.cc:769] Sending connection context
0808 08:43:38.423739 (+ 358us) client_negotiation.cc:240] Negotiation successful
0808 08:43:38.424423 (+ 684us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":363,"threads_started":1}
I20260808 08:43:38.428620 6339 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37935
I20260808 08:43:38.429006 6339 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:38.430238 6339 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
I20260808 08:43:38.432420 5827 ts_manager.cc:194] Registered new tserver with Master: 3cdfbe40874149968b51e5c2d8be890f (127.19.242.194:43667)
I20260808 08:43:38.433610 5827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:50809
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:43:38.482357 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37935
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:43:38.624326 6127 heartbeater.cc:503] Master 127.19.242.254:37935 was elected leader, sending a full tablet report...
W20260808 08:43:38.934890 6348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:38.935285 6348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:38.935460 6348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:38.944370 6348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:38.944563 6348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:38.944752 6348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:43:38.956095 6348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.242.212:53629/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:38.957693 6348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:38.959143 6348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:38.976056 6356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:38.976306 6362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:38.976339 6355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:38.976784 6348 server_base.cc:1034] running on GCE node
I20260808 08:43:38.977814 6348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:38.979200 6348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:38.980510 6348 hybrid_clock.cc:648] HybridClock initialized: now 1786178618980399 us; error 71 us; skew 500 ppm
I20260808 08:43:38.980882 6348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:38 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:38.985178 6348 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:43:38.987012 6348 webserver.cc:460] Webserver started at http://127.19.242.195:36635/ using document root <none> and password file <none>
I20260808 08:43:38.987802 6348 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:38.987954 6348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:38.988291 6348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:43:38 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:39.005012 6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "330a458f72734b7181bbbca6319781c7"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "7cf805d089fa63287b55883d921334ba"
server_key_iv: "ad0c337d825a045c598eff18d5995ad5"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:39.006083 6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "330a458f72734b7181bbbca6319781c7"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "7cf805d089fa63287b55883d921334ba"
server_key_iv: "ad0c337d825a045c598eff18d5995ad5"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:39.012928 6348 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 08:43:39.030964 6373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:39.032907 6348 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:43:39.033105 6348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "330a458f72734b7181bbbca6319781c7"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "7cf805d089fa63287b55883d921334ba"
server_key_iv: "ad0c337d825a045c598eff18d5995ad5"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:39.033352 6348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:39.051072 6348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:39.056660 6348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:39.057065 6348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:39.058548 6348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:39.060623 6348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:39.060753 6348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:39.060912 6348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:39.060987 6348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:39.123590 6348 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:35557
I20260808 08:43:39.123610 6543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:35557 every 8 connection(s)
I20260808 08:43:39.125284 6348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:43:39.133659 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 6348
I20260808 08:43:39.133888 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:43:39.134497 20427 external_mini_cluster.cc:1428] Setting key 56d22ffaa3d04902517fa217b8391e90
Aug 08 08:43:39 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178618, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:39.153133 6546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:39.128869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:36883 (local address 127.19.242.254:37935)
0808 08:43:39.129615 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:39.129622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:39.130999 (+ 1377us) server_negotiation.cc:407] Connection header received
0808 08:43:39.133508 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:39.133514 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:39.133617 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:39.133754 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:39.136320 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.137323 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.140027 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.140679 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.140788 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:39.145526 (+ 4738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:39.145532 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:39.145535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:39.145575 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:39.148843 (+ 3268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.150148 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.150155 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.150158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.150336 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.150945 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.150951 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.150954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.151385 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:39.151559 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:39.152444 (+ 885us) server_negotiation.cc:299] Negotiation successful
0808 08:43:39.152736 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":316,"threads_started":1}
I20260808 08:43:39.153932 6547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:39.129692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37935 (local address 127.19.242.195:36883)
0808 08:43:39.130773 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:39.130844 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:39.133064 (+ 2220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:39.134083 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:39.134097 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:39.134810 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:39.135952 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:39.135983 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.137495 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.137501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:39.139850 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:39.139869 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.140951 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.140959 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:39.141311 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:39.142204 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:39.142239 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:39.145195 (+ 2956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:39.149077 (+ 3882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:39.149089 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:39.149112 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:39.149954 (+ 842us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:39.150463 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:39.150469 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:39.150473 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:39.150771 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:39.151527 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:39.151535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:39.151982 (+ 447us) client_negotiation.cc:769] Sending connection context
0808 08:43:39.152256 (+ 274us) client_negotiation.cc:240] Negotiation successful
0808 08:43:39.152730 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":501,"threads_started":1}
I20260808 08:43:39.155757 6544 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37935
I20260808 08:43:39.156153 6544 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:39.157153 6544 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
I20260808 08:43:39.159435 5827 ts_manager.cc:194] Registered new tserver with Master: 330a458f72734b7181bbbca6319781c7 (127.19.242.195:35557)
I20260808 08:43:39.160420 5827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:36883
I20260808 08:43:39.164173 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:43:39.165907 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 5945
Aug 08 08:43:39 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:43:39.190677 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:39.167032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36410 (local address 127.19.242.193:34637)
0808 08:43:39.168757 (+ 1725us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:39.168767 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:39.168801 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:43:39.168924 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:39.168934 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:39.169223 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:39.169433 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:39.171453 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.173192 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.175263 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.176364 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.176512 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:39.182173 (+ 5661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:39.182214 (+ 41us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:39.182238 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:39.182300 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:39.186889 (+ 4589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.188031 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.188043 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.188048 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.188275 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.188809 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.188815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.188818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.189316 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:39.189645 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:39.189953 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 08:43:39.190251 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1519,"thread_start_us":1310,"threads_started":1}
I20260808 08:43:39.192313 6121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:39.284181 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 5945
I20260808 08:43:39.316553 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 6136
Aug 08 08:43:39 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:43:39.340869 6551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:39.317601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37054 (local address 127.19.242.194:43667)
0808 08:43:39.318130 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:39.318138 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:39.318164 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:43:39.318242 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:39.318248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:39.318453 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:39.318660 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:39.320296 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.321419 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.322889 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.323498 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.323656 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:39.333415 (+ 9759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:39.333436 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:39.333458 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:39.333516 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:39.337417 (+ 3901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.338369 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.338380 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.338383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.338630 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.339101 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.339107 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.339110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.339583 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:39.339876 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:39.340170 (+ 294us) server_negotiation.cc:299] Negotiation successful
0808 08:43:39.340450 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":264,"threads_started":1}
I20260808 08:43:39.342372 6332 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:39.426986 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 6136
I20260808 08:43:39.450316 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 6348
Aug 08 08:43:39 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178615, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:43:39.469034 6553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:39.451443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60578 (local address 127.19.242.195:35557)
0808 08:43:39.452138 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:39.452145 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:39.452176 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:43:39.452243 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:39.452249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:39.452456 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:39.452618 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:39.454238 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.455561 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.456967 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:39.457637 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:39.457758 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:39.462331 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:39.462348 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:39.462365 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:39.462411 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:39.465745 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.466593 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.466601 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.466603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.466859 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:39.467250 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:39.467254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:39.467256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:39.467717 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:39.467992 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:39.468320 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 08:43:39.468675 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":345,"threads_started":1}
I20260808 08:43:39.470456 6537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:39.556932 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 6348
I20260808 08:43:39.589752 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 5779
I20260808 08:43:39.591077 5875 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:39.701830 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 5779
I20260808 08:43:39.735725 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37935
--webserver_interface=127.19.242.254
--webserver_port=40181
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:37935
--ranger_config_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:40.121567 6557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:40.121929 6557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:40.122107 6557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:40.129978 6557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:40.130137 6557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:40.130237 6557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:40.130347 6557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:40.130425 6557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:40.142534 6557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:37935
--ranger_config_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=40181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:40.144104 6557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:40.145604 6557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:40.159286 6566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:40.159474 6565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:40.159628 6570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:40.160420 6557 server_base.cc:1034] running on GCE node
I20260808 08:43:40.161463 6557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:40.163170 6557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:40.164436 6557 hybrid_clock.cc:648] HybridClock initialized: now 1786178620164393 us; error 34 us; skew 500 ppm
I20260808 08:43:40.164882 6557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:40 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:40.168587 6557 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:43:40.170387 6557 webserver.cc:460] Webserver started at http://127.19.242.254:40181/ using document root <none> and password file <none>
I20260808 08:43:40.171192 6557 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:40.171324 6557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:43:40 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:40.226456 6557 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 08:43:40.229998 6579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:40.231885 6557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:40.232125 6557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "92fe976957154c15b3a7ec84f7764a05"
format_stamp: "Formatted at 2026-08-08 08:43:35 on dist-test-slave-39l8"
server_key: "0d62e0256be669ec82144db31c0dfc6e"
server_key_iv: "dfd16ede7439dfff23173e9d4ec9e8fb"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:40.233142 6557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:40.267521 6557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:40.272133 6557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:40.272408 6557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:40.293107 6557 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:37935
I20260808 08:43:40.293171 6645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:37935 every 8 connection(s)
I20260808 08:43:40.294854 6557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:43:40.299652 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 6557
I20260808 08:43:40.300612 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:34637
--local_ip_for_outbound_sockets=127.19.242.193
--tserver_master_addrs=127.19.242.254:37935
--webserver_port=37997
--webserver_interface=127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:43:40.303004 6646 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:43:40.306694 6646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Bootstrap starting.
I20260808 08:43:40.327462 6646 log.cc:824] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:40.337765 6646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:43:40.338408 6646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Bootstrap complete.
I20260808 08:43:40.348186 6646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:40.349171 6646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fe976957154c15b3a7ec84f7764a05, State: Initialized, Role: FOLLOWER
I20260808 08:43:40.349864 6646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:40.350152 6646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:43:40.350298 6646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:43:40.350502 6646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:43:40.355728 6646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:40.356539 6646 leader_election.cc:302] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92fe976957154c15b3a7ec84f7764a05; no voters:
I20260808 08:43:40.357308 6646 leader_election.cc:288] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:43:40.357472 6654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:43:40.358415 6654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [term 2 LEADER]: Becoming Leader. State: Replica: 92fe976957154c15b3a7ec84f7764a05, State: Running, Role: LEADER
I20260808 08:43:40.359014 6654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } }
I20260808 08:43:40.359808 6646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:43:40.361758 6657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92fe976957154c15b3a7ec84f7764a05. Latest consensus state: current_term: 2 leader_uuid: "92fe976957154c15b3a7ec84f7764a05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } } }
I20260808 08:43:40.362323 6657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:40.363066 6656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "92fe976957154c15b3a7ec84f7764a05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92fe976957154c15b3a7ec84f7764a05" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37935 } } }
I20260808 08:43:40.363433 6656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:40.365446 6669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:43:40.373473 6669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:43:40.375905 6669 catalog_manager.cc:1259] Loaded cluster ID: 37e54cf285a94fd382df8bc4035d2069
I20260808 08:43:40.376210 6669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:43:40.382247 6669 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:43:40.384740 6669 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Loaded TSK: 0
I20260808 08:43:40.387948 6669 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:43:40.395922 6646 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260808 08:43:40.807916 6651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:40.808339 6651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:40.808518 6651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:40.818094 6651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:40.818274 6651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:40.818500 6651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:43:40.831094 6651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:34637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=37997
--tserver_master_addrs=127.19.242.254:37935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:40.832621 6651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:40.834293 6651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:40.876214 6712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:40.877660 6713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:40.887351 6716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:40.887949 6651 server_base.cc:1034] running on GCE node
I20260808 08:43:40.889252 6651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:40.899117 6651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:40.902669 6651 hybrid_clock.cc:648] HybridClock initialized: now 1786178620902552 us; error 118 us; skew 500 ppm
I20260808 08:43:40.903280 6651 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:40 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:40.908836 6651 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:43:40.915742 6651 webserver.cc:460] Webserver started at http://127.19.242.193:37997/ using document root <none> and password file <none>
I20260808 08:43:40.916879 6651 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:40.917090 6651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:43:40 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:40.977360 6651 fs_manager.cc:709] Time spent opening directory manager: real 0.020s user 0.015s sys 0.004s
I20260808 08:43:40.983842 6727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:40.986150 6651 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.003s
I20260808 08:43:40.986400 6651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "84494bae45d84ae586311d9331f6ea3e"
format_stamp: "Formatted at 2026-08-08 08:43:37 on dist-test-slave-39l8"
server_key: "e4810c8bb8daf97de6cc79666c1afd32"
server_key_iv: "49ef82487f06c81f16850decf27a38da"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:40.987982 6651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:41.050019 6651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:41.056874 6651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:41.057345 6651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:41.058952 6651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:41.061292 6651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:41.061435 6651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:41.061578 6651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:41.061671 6651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:41.135846 6651 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:34637
I20260808 08:43:41.135896 6883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:34637 every 8 connection(s)
I20260808 08:43:41.137672 6651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:43:41.139477 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 6651
I20260808 08:43:41.140379 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:43667
--local_ip_for_outbound_sockets=127.19.242.194
--tserver_master_addrs=127.19.242.254:37935
--webserver_port=36145
--webserver_interface=127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:43:41 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178620, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:41.210886 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:41.142386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37935 (local address 127.19.242.193:33075)
0808 08:43:41.172168 (+ 29782us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:41.172282 (+ 114us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:41.186458 (+ 14176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:41.189437 (+ 2979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:41.189444 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:41.189950 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:41.190619 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:41.190639 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.192556 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.192561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:41.193867 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:41.193882 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.195668 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.195685 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:41.195982 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:41.196885 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:41.196918 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:41.199591 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:41.205112 (+ 5521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:41.205123 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:41.205144 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:41.205834 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:41.206508 (+ 674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:41.206514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:41.206518 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:41.206865 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:41.207887 (+ 1022us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:41.207897 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:41.208319 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 08:43:41.208675 (+ 356us) client_negotiation.cc:240] Negotiation successful
0808 08:43:41.209352 (+ 677us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29212,"thread_start_us":32166,"threads_started":1}
I20260808 08:43:41.210880 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:41.144107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:33075 (local address 127.19.242.254:37935)
0808 08:43:41.176726 (+ 32619us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:41.176755 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:41.176838 (+ 83us) server_negotiation.cc:407] Connection header received
0808 08:43:41.187861 (+ 11023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:41.187888 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:41.188407 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:41.188730 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:41.190970 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.192331 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.194047 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.194985 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.195188 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:41.200021 (+ 4833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:41.200032 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:41.200069 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:41.200146 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:41.204891 (+ 4745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:41.206062 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:41.206074 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:41.206084 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:41.206335 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:41.207026 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:41.207032 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:41.207035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:41.207644 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:41.207992 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:41.208955 (+ 963us) server_negotiation.cc:299] Negotiation successful
0808 08:43:41.209367 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32211,"thread_start_us":32595,"threads_started":1}
I20260808 08:43:41.215087 6884 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37935
I20260808 08:43:41.215461 6884 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:41.216344 6884 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
W20260808 08:43:41.219810 6884 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:37935 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:43:41.220075 6884 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:41.220328 6884 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
I20260808 08:43:41.221663 6884 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:41.222031 6884 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
W20260808 08:43:41.223333 6884 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:43:41.645474 6888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:41.646198 6888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:41.646494 6888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:41.660686 6888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:41.660959 6888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:41.661234 6888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:43:41.680114 6888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:43667
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=36145
--tserver_master_addrs=127.19.242.254:37935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:41.682065 6888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:41.684088 6888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:41.710531 6912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:41.711280 6911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:41.711679 6914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:41.713968 6888 server_base.cc:1034] running on GCE node
I20260808 08:43:41.715052 6888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
Aug 08 08:43:41 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:41.716661 6888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:41.718017 6888 hybrid_clock.cc:648] HybridClock initialized: now 1786178621717932 us; error 55 us; skew 500 ppm
I20260808 08:43:41.718479 6888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:41 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:41.726824 6888 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:43:41.747452 6888 webserver.cc:460] Webserver started at http://127.19.242.194:36145/ using document root <none> and password file <none>
I20260808 08:43:41.748461 6888 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:41.748692 6888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:43:41 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:41.779454 6888 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 08:43:41.782969 6925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:41.784814 6888 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:43:41.785156 6888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "3cdfbe40874149968b51e5c2d8be890f"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "a6eaf182ed520cc491716937628dbd5f"
server_key_iv: "fd3db8a66d61681202b87bb272f6963b"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:41.787000 6888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:41.805640 6888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:41.812063 6888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:41.812451 6888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:41.814073 6888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:41.816387 6888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:41.816535 6888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:41.816788 6888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:41.816893 6888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:41.878396 6888 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:43667
I20260808 08:43:41.878479 7093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:43667 every 8 connection(s)
I20260808 08:43:41.880722 6888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:43:41.888659 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 6888
I20260808 08:43:41.889492 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.242.212:53629/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:35557
--local_ip_for_outbound_sockets=127.19.242.195
--tserver_master_addrs=127.19.242.254:37935
--webserver_port=36635
--webserver_interface=127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:35279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:43:41 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:41.971254 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:41.886741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:37249 (local address 127.19.242.254:37935)
0808 08:43:41.935310 (+ 48569us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:41.935322 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:41.939068 (+ 3746us) server_negotiation.cc:407] Connection header received
0808 08:43:41.945259 (+ 6191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:41.945268 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:41.945391 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:41.945506 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:41.948550 (+ 3044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.949922 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.953011 (+ 3089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.953781 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.953913 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:41.959792 (+ 5879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:41.959805 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:41.959811 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:41.959867 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:41.966312 (+ 6445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:41.967766 (+ 1454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:41.967775 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:41.967779 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:41.967972 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:41.968628 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:41.968634 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:41.968638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:41.969101 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:41.969259 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:41.970488 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0808 08:43:41.970827 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48346,"thread_start_us":48199,"threads_started":1}
I20260808 08:43:41.974913 7097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:41.885880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37935 (local address 127.19.242.194:37249)
0808 08:43:41.938536 (+ 52656us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:41.938612 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:41.942280 (+ 3668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:41.946373 (+ 4093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:41.946388 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:41.947217 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:41.948263 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:41.948298 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.950193 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.950201 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:41.952748 (+ 2547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:41.952773 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:41.954398 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:41.954408 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:41.954811 (+ 403us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:41.956292 (+ 1481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:41.956331 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:41.959391 (+ 3060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:41.966627 (+ 7236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:41.966641 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:41.966666 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:41.967502 (+ 836us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:41.968162 (+ 660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:41.968168 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:41.968172 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:41.968456 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:41.969380 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:41.969390 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:41.969936 (+ 546us) client_negotiation.cc:769] Sending connection context
0808 08:43:41.971923 (+ 1987us) client_negotiation.cc:240] Negotiation successful
0808 08:43:41.972751 (+ 828us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51644,"thread_start_us":51331,"threads_started":1}
I20260808 08:43:41.979367 7094 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37935
I20260808 08:43:41.979799 7094 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:41.980929 7094 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
I20260808 08:43:41.985225 6600 ts_manager.cc:194] Registered new tserver with Master: 3cdfbe40874149968b51e5c2d8be890f (127.19.242.194:43667)
I20260808 08:43:41.988389 6600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:37249
I20260808 08:43:42.223507 6884 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:42.224030 6884 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
I20260808 08:43:42.225307 6600 ts_manager.cc:194] Registered new tserver with Master: 84494bae45d84ae586311d9331f6ea3e (127.19.242.193:34637)
I20260808 08:43:42.226431 6600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:33075
Aug 08 08:43:42 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
W20260808 08:43:42.469859 7099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:42.470345 7099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:42.470528 7099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:42.483071 7099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:42.483255 7099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:42.483457 7099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:43:42.500702 7099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:35279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.242.212:53629/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:35557
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=36635
--tserver_master_addrs=127.19.242.254:37935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:42.502607 7099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:42.504446 7099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:42.523224 7108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:42.523252 7110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:42.540795 7114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:42.541847 7099 server_base.cc:1034] running on GCE node
I20260808 08:43:42.542677 7099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:42.544175 7099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:42.545431 7099 hybrid_clock.cc:648] HybridClock initialized: now 1786178622545359 us; error 70 us; skew 500 ppm
I20260808 08:43:42.545812 7099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:42 dist-test-slave-39l8 krb5kdc[5128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:42.554646 7099 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:43:42.556921 7099 webserver.cc:460] Webserver started at http://127.19.242.195:36635/ using document root <none> and password file <none>
I20260808 08:43:42.557753 7099 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:42.557940 7099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:43:42 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:42.589213 7099 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.004s sys 0.003s
I20260808 08:43:42.595072 7126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:42.597285 7099 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260808 08:43:42.597532 7099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "330a458f72734b7181bbbca6319781c7"
format_stamp: "Formatted at 2026-08-08 08:43:38 on dist-test-slave-39l8"
server_key: "7cf805d089fa63287b55883d921334ba"
server_key_iv: "ad0c337d825a045c598eff18d5995ad5"
server_key_version: "kuduclusterkey@0"
I20260808 08:43:42.599098 7099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:42.619786 7099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
Aug 08 08:43:42 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for HTTP/127.19.242.212@KRBTEST.COM
I20260808 08:43:42.627933 7099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:42.628314 7099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:42.630352 7099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:42.632195 7099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:42.632287 7099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:42.632373 7099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:42.632422 7099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:42.827724 7290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:35557 every 8 connection(s)
I20260808 08:43:42.828137 7099 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:35557
I20260808 08:43:42.830264 7099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:43:42.840818 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 7099
Aug 08 08:43:42 dist-test-slave-39l8 krb5kdc[5128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:42.876025 7294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.837877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:44735 (local address 127.19.242.254:37935)
0808 08:43:42.838468 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:42.838475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:42.852311 (+ 13836us) server_negotiation.cc:407] Connection header received
0808 08:43:42.852427 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:42.852436 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:42.852601 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:42.852742 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:42.857209 (+ 4467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.858416 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.861056 (+ 2640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.861777 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.861889 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:42.867028 (+ 5139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:42.867036 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:42.867041 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:42.867095 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:42.871167 (+ 4072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:42.872498 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:42.872506 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:42.872511 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:42.872729 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:42.873420 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:42.873425 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:42.873429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:42.873850 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:42.874000 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:42.875267 (+ 1267us) server_negotiation.cc:299] Negotiation successful
0808 08:43:42.875574 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":315,"threads_started":1}
I20260808 08:43:42.878924 7293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.837200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37935 (local address 127.19.242.195:44735)
0808 08:43:42.847790 (+ 10590us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:42.847860 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:42.851643 (+ 3783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:42.855232 (+ 3589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:42.855247 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:42.855972 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:42.856910 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:42.856940 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.858673 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.858679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:42.860829 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:42.860849 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.862329 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.862336 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:42.862670 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:42.863635 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:42.863675 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:42.866621 (+ 2946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:42.871435 (+ 4814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:42.871447 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:42.871470 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:42.872290 (+ 820us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:42.872949 (+ 659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:42.872954 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:42.872958 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:42.873262 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:42.874123 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:42.874132 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:42.874648 (+ 516us) client_negotiation.cc:769] Sending connection context
0808 08:43:42.876633 (+ 1985us) client_negotiation.cc:240] Negotiation successful
0808 08:43:42.877332 (+ 699us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10207,"thread_start_us":9631,"threads_started":1}
I20260808 08:43:42.881284 7292 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37935
I20260808 08:43:42.881646 7292 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:42.882752 7292 heartbeater.cc:511] Master 127.19.242.254:37935 requested a full tablet report, sending...
I20260808 08:43:42.884931 6600 ts_manager.cc:194] Registered new tserver with Master: 330a458f72734b7181bbbca6319781c7 (127.19.242.195:35557)
I20260808 08:43:42.885921 6600 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:44735
I20260808 08:43:42.905368 7297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.842392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45128 (local address 127.19.242.254:37935)
0808 08:43:42.875819 (+ 33427us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:42.875825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:42.884534 (+ 8709us) server_negotiation.cc:407] Connection header received
0808 08:43:42.884798 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:42.884804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:42.884923 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:42.885135 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:42.887425 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.888656 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.890815 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.891490 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.891640 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:42.895856 (+ 4216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:42.895865 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:42.895871 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:42.895929 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:42.900296 (+ 4367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:42.901593 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:42.901601 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:42.901605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:42.901816 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:42.902381 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:42.902386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:42.902390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:42.902839 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:42.903147 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:42.904556 (+ 1409us) server_negotiation.cc:299] Negotiation successful
0808 08:43:42.904855 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33115,"thread_start_us":33242,"threads_started":1}
I20260808 08:43:42.909507 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:43:42.935916 7297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.918243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45138 (local address 127.19.242.254:37935)
0808 08:43:42.918503 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:42.918513 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:42.919129 (+ 616us) server_negotiation.cc:407] Connection header received
0808 08:43:42.919374 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:42.919380 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:42.919468 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:42.919594 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:42.922183 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.923009 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.924667 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.925145 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.925327 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:42.929311 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:42.929317 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:42.929321 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:42.929367 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:42.932680 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:42.933830 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:42.933834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:42.933836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:42.933991 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:42.934478 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:42.934481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:42.934483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:42.934854 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:42.935065 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:42.935473 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 08:43:42.935671 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:43:42.943377 6600 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:43:42.953629 6600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:43:42.996327 7094 heartbeater.cc:503] Master 127.19.242.254:37935 was elected leader, sending a full tablet report...
I20260808 08:43:43.001978 7323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.971216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:35557 (local address 127.0.0.1:60592)
0808 08:43:42.978814 (+ 7598us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:42.978866 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:42.979140 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:42.989213 (+ 10073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:42.989232 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:42.989293 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:42.990100 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:42.990136 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.993948 (+ 3812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.993955 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:42.998057 (+ 4102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:42.998077 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.000635 (+ 2558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.000642 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.000921 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.001010 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 08:43:43.001164 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 08:43:43.001414 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7175,"mutex_wait_us":1,"thread_start_us":6968,"threads_started":1}
I20260808 08:43:43.002885 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.971860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60592 (local address 127.19.242.195:35557)
0808 08:43:42.987981 (+ 16121us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:42.987997 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:42.988072 (+ 75us) server_negotiation.cc:407] Connection header received
0808 08:43:42.988250 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:42.988266 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:42.988684 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:42.990458 (+ 1774us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:42.991072 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.993746 (+ 2674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.998387 (+ 4641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.000317 (+ 1930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.001775 (+ 1458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.002050 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.002146 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.002366 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15872,"thread_start_us":15683,"threads_started":1}
I20260808 08:43:43.003453 7329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.985175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:43667 (local address 127.0.0.1:36102)
0808 08:43:42.991514 (+ 6339us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:42.991545 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:42.991710 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:42.993076 (+ 1366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:42.993081 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:42.993110 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:42.993715 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:42.993741 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.995888 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.995898 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:42.999768 (+ 3870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:42.999786 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.002441 (+ 2655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.002449 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.002633 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.002667 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:43:43.002857 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 08:43:43.003017 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6113,"mutex_wait_us":1,"thread_start_us":5823,"threads_started":1}
I20260808 08:43:43.004354 7328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.979766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36102 (local address 127.19.242.194:43667)
0808 08:43:42.992418 (+ 12652us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:42.992425 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:42.992451 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:43:42.992537 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:42.992543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:42.992817 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:42.993083 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:42.994000 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.995713 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.999974 (+ 4261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.001651 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.001973 (+ 322us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.002208 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.003700 (+ 1492us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.003941 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12470,"thread_start_us":12287,"threads_started":1}
I20260808 08:43:43.005425 7326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.972149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:34637 (local address 127.0.0.1:53016)
0808 08:43:42.987141 (+ 14992us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:42.987171 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:42.987378 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:42.996487 (+ 9109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:42.996494 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:42.996532 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:42.997273 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:42.997286 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.999207 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:42.999213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.001596 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:43.001614 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.004544 (+ 2930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.004553 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.004752 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.004786 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:43:43.004862 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 08:43:43.004999 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14805,"mutex_wait_us":59,"thread_start_us":14448,"threads_started":1}
I20260808 08:43:43.006798 7327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:42.972598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53016 (local address 127.19.242.193:34637)
0808 08:43:42.995655 (+ 23057us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:42.995665 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:42.995698 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:43:42.995812 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:42.995823 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:42.996180 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:42.996921 (+ 741us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:42.997534 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:42.999060 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.001891 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.004246 (+ 2355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.005426 (+ 1180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.005965 (+ 539us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.006049 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.006241 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22818,"thread_start_us":22636,"threads_started":1}
I20260808 08:43:43.007949 7191 tablet_service.cc:1467] Processing CreateTablet for tablet bcf77a7f0c3e4976af2f1071636b5cf1 (DEFAULT_TABLE table=test-table [id=87a5b9df310242b9aabe18b0f1116b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:43.008136 7007 tablet_service.cc:1467] Processing CreateTablet for tablet bcf77a7f0c3e4976af2f1071636b5cf1 (DEFAULT_TABLE table=test-table [id=87a5b9df310242b9aabe18b0f1116b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:43.009799 7007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcf77a7f0c3e4976af2f1071636b5cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:43.009868 7191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcf77a7f0c3e4976af2f1071636b5cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:43.011579 6793 tablet_service.cc:1467] Processing CreateTablet for tablet bcf77a7f0c3e4976af2f1071636b5cf1 (DEFAULT_TABLE table=test-table [id=87a5b9df310242b9aabe18b0f1116b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:43.013440 6793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcf77a7f0c3e4976af2f1071636b5cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:43.025014 7330 tablet_bootstrap.cc:492] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Bootstrap starting.
I20260808 08:43:43.029839 7330 tablet_bootstrap.cc:654] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:43.031728 7330 log.cc:824] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:43.033062 7331 tablet_bootstrap.cc:492] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Bootstrap starting.
I20260808 08:43:43.035702 7333 tablet_bootstrap.cc:492] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Bootstrap starting.
I20260808 08:43:43.039105 7331 tablet_bootstrap.cc:654] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:43.040864 7330 tablet_bootstrap.cc:492] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: No bootstrap required, opened a new log
I20260808 08:43:43.041026 7331 log.cc:824] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:43.041218 7330 ts_tablet_manager.cc:1397] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.012s
I20260808 08:43:43.041347 7333 tablet_bootstrap.cc:654] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:43.043256 7333 log.cc:824] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:43.045817 7331 tablet_bootstrap.cc:492] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: No bootstrap required, opened a new log
I20260808 08:43:43.046224 7331 ts_tablet_manager.cc:1397] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260808 08:43:43.049724 7333 tablet_bootstrap.cc:492] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: No bootstrap required, opened a new log
I20260808 08:43:43.050101 7333 ts_tablet_manager.cc:1397] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20260808 08:43:43.053992 7330 raft_consensus.cc:348] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.054633 7330 raft_consensus.cc:374] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:43.054798 7330 raft_consensus.cc:729] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330a458f72734b7181bbbca6319781c7, State: Initialized, Role: FOLLOWER
I20260808 08:43:43.055617 7330 consensus_queue.cc:260] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.057240 7292 heartbeater.cc:503] Master 127.19.242.254:37935 was elected leader, sending a full tablet report...
I20260808 08:43:43.058097 7330 ts_tablet_manager.cc:1428] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Time spent starting tablet: real 0.017s user 0.014s sys 0.003s
I20260808 08:43:43.060228 7331 raft_consensus.cc:348] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.060832 7331 raft_consensus.cc:374] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:43.061026 7331 raft_consensus.cc:729] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cdfbe40874149968b51e5c2d8be890f, State: Initialized, Role: FOLLOWER
I20260808 08:43:43.061225 7333 raft_consensus.cc:348] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.061909 7333 raft_consensus.cc:374] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:43.062031 7333 raft_consensus.cc:729] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84494bae45d84ae586311d9331f6ea3e, State: Initialized, Role: FOLLOWER
I20260808 08:43:43.061887 7331 consensus_queue.cc:260] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.063491 7333 consensus_queue.cc:260] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.065297 7331 ts_tablet_manager.cc:1428] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Time spent starting tablet: real 0.019s user 0.015s sys 0.004s
I20260808 08:43:43.067133 6884 heartbeater.cc:503] Master 127.19.242.254:37935 was elected leader, sending a full tablet report...
I20260808 08:43:43.067957 7333 ts_tablet_manager.cc:1428] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Time spent starting tablet: real 0.018s user 0.014s sys 0.005s
I20260808 08:43:43.097338 7339 raft_consensus.cc:482] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:43:43.097826 7339 raft_consensus.cc:504] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.100010 7339 leader_election.cc:288] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330a458f72734b7181bbbca6319781c7 (127.19.242.195:35557), 3cdfbe40874149968b51e5c2d8be890f (127.19.242.194:43667)
W20260808 08:43:43.104496 7298 tablet.cc:2369] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:43:43.109804 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.100712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:60201 (local address 127.19.242.195:35557)
0808 08:43:43.100994 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:43.101004 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:43.101569 (+ 565us) server_negotiation.cc:407] Connection header received
0808 08:43:43.101775 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:43.101783 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:43.101887 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:43.102002 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:43.102864 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.103905 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.107237 (+ 3332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.108546 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.108708 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.108771 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.109313 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.109515 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:43:43.109927 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.100558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:35557 (local address 127.19.242.193:60201)
0808 08:43:43.101398 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:43.101416 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:43.101621 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:43.102053 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:43.102064 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:43.102101 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:43.102667 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:43.102680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.104182 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.104189 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.106991 (+ 2802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:43.107018 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.108823 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.108831 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.109053 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.109099 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 08:43:43.109231 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 08:43:43.109441 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":531,"threads_started":1}
I20260808 08:43:43.110575 7341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.101528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:43667 (local address 127.19.242.193:55537)
0808 08:43:43.102299 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:43.102324 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:43.102463 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:43.102868 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:43.102873 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:43.102905 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:43.103366 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:43.103376 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.104774 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.104784 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.107881 (+ 3097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:43.107900 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.109594 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.109601 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:43.109775 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.109815 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:43:43.109943 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 08:43:43.110082 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":398,"threads_started":1}
I20260808 08:43:43.110685 7328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.101698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:55537 (local address 127.19.242.194:43667)
0808 08:43:43.101938 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:43.101947 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:43.102428 (+ 481us) server_negotiation.cc:407] Connection header received
0808 08:43:43.102623 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:43.102627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:43.102690 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:43.102847 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:43.103549 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.104479 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.108106 (+ 3627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.109311 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.109490 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.109588 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.110140 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.110314 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:43:43.111780 7219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf77a7f0c3e4976af2f1071636b5cf1" candidate_uuid: "84494bae45d84ae586311d9331f6ea3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330a458f72734b7181bbbca6319781c7" is_pre_election: true
I20260808 08:43:43.112290 7035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf77a7f0c3e4976af2f1071636b5cf1" candidate_uuid: "84494bae45d84ae586311d9331f6ea3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cdfbe40874149968b51e5c2d8be890f" is_pre_election: true
I20260808 08:43:43.112564 7219 raft_consensus.cc:2454] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84494bae45d84ae586311d9331f6ea3e in term 0.
I20260808 08:43:43.112942 7035 raft_consensus.cc:2454] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84494bae45d84ae586311d9331f6ea3e in term 0.
I20260808 08:43:43.113476 6732 leader_election.cc:302] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330a458f72734b7181bbbca6319781c7, 84494bae45d84ae586311d9331f6ea3e; no voters:
I20260808 08:43:43.114022 7339 raft_consensus.cc:2781] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:43:43.114295 7339 raft_consensus.cc:482] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:43:43.114449 7339 raft_consensus.cc:3037] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:43.117230 7339 raft_consensus.cc:504] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.118060 7339 leader_election.cc:288] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [CANDIDATE]: Term 1 election: Requested vote from peers 330a458f72734b7181bbbca6319781c7 (127.19.242.195:35557), 3cdfbe40874149968b51e5c2d8be890f (127.19.242.194:43667)
I20260808 08:43:43.118928 7035 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf77a7f0c3e4976af2f1071636b5cf1" candidate_uuid: "84494bae45d84ae586311d9331f6ea3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cdfbe40874149968b51e5c2d8be890f"
I20260808 08:43:43.118929 7219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf77a7f0c3e4976af2f1071636b5cf1" candidate_uuid: "84494bae45d84ae586311d9331f6ea3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330a458f72734b7181bbbca6319781c7"
I20260808 08:43:43.119199 7219 raft_consensus.cc:3037] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:43.119263 7035 raft_consensus.cc:3037] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:43.123106 7035 raft_consensus.cc:2454] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84494bae45d84ae586311d9331f6ea3e in term 1.
I20260808 08:43:43.123104 7219 raft_consensus.cc:2454] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84494bae45d84ae586311d9331f6ea3e in term 1.
I20260808 08:43:43.123837 6732 leader_election.cc:302] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330a458f72734b7181bbbca6319781c7, 84494bae45d84ae586311d9331f6ea3e; no voters:
I20260808 08:43:43.124322 7339 raft_consensus.cc:2781] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:43:43.124934 7339 raft_consensus.cc:686] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 1 LEADER]: Becoming Leader. State: Replica: 84494bae45d84ae586311d9331f6ea3e, State: Running, Role: LEADER
I20260808 08:43:43.125506 7339 consensus_queue.cc:237] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } }
I20260808 08:43:43.131935 6600 catalog_manager.cc:5495] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 84494bae45d84ae586311d9331f6ea3e (127.19.242.193). New cstate: current_term: 1 leader_uuid: "84494bae45d84ae586311d9331f6ea3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84494bae45d84ae586311d9331f6ea3e" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34637 } health_report { overall_health: HEALTHY } } }
I20260808 08:43:43.154019 7327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.147624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53024 (local address 127.19.242.193:34637)
0808 08:43:43.147874 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:43.147880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:43.147902 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:43:43.148210 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:43.148213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:43.148317 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:43.148507 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:43:43.149086 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.149875 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.151555 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.152050 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.152236 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.152797 (+ 561us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:43:43.153351 (+ 554us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:43:43.153523 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.153634 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.153728 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 08:43:43.164439 7035 raft_consensus.cc:1261] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 1 FOLLOWER]: Refusing update from remote peer 84494bae45d84ae586311d9331f6ea3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:43:43.164446 7219 raft_consensus.cc:1261] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 1 FOLLOWER]: Refusing update from remote peer 84494bae45d84ae586311d9331f6ea3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:43:43.165607 7342 consensus_queue.cc:1035] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cdfbe40874149968b51e5c2d8be890f" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:43:43.166159 7339 consensus_queue.cc:1035] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "330a458f72734b7181bbbca6319781c7" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 35557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:43:43.180502 7347 mvcc.cc:205] Tried to move back new op lower bound from 7316187640468324352 to 7316187640327184384. Current Snapshot: MvccSnapshot[applied={T|T < 7316187640468324352}]
I20260808 08:43:43.188649 7348 mvcc.cc:205] Tried to move back new op lower bound from 7316187640468324352 to 7316187640327184384. Current Snapshot: MvccSnapshot[applied={T|T < 7316187640468324352}]
I20260808 08:43:43.200349 6598 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:43:43.200891 6598 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45138:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:43:43.205920 6598 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92fe976957154c15b3a7ec84f7764a05: Sending DeleteTablet for 3 replicas of tablet bcf77a7f0c3e4976af2f1071636b5cf1
I20260808 08:43:43.207489 7191 tablet_service.cc:1514] Processing DeleteTablet for tablet bcf77a7f0c3e4976af2f1071636b5cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:43:43 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:60592
I20260808 08:43:43.207713 6793 tablet_service.cc:1514] Processing DeleteTablet for tablet bcf77a7f0c3e4976af2f1071636b5cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:43:43 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:53016
I20260808 08:43:43.208366 7007 tablet_service.cc:1514] Processing DeleteTablet for tablet bcf77a7f0c3e4976af2f1071636b5cf1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:43:43 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:36102
I20260808 08:43:43.216306 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 6651
I20260808 08:43:43.222628 7361 tablet_replica.cc:330] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: stopping tablet replica
I20260808 08:43:43.223629 7363 tablet_replica.cc:330] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: stopping tablet replica
I20260808 08:43:43.223687 7359 tablet_replica.cc:330] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: stopping tablet replica
I20260808 08:43:43.224057 7363 raft_consensus.cc:2229] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:43:43.224174 7359 raft_consensus.cc:2229] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:43:43.224759 7363 raft_consensus.cc:2258] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:43:43.224805 7359 raft_consensus.cc:2258] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:43:43.223217 7361 raft_consensus.cc:2229] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:43:43.226030 7361 raft_consensus.cc:2258] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:43:43.227381 7359 ts_tablet_manager.cc:1905] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:43:43.228624 7361 ts_tablet_manager.cc:1905] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:43:43.236271 7359 ts_tablet_manager.cc:1918] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:43:43.236485 7359 log.cc:1196] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/bcf77a7f0c3e4976af2f1071636b5cf1
I20260808 08:43:43.237183 7363 ts_tablet_manager.cc:1905] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:43:43.237228 7359 ts_tablet_manager.cc:1939] T bcf77a7f0c3e4976af2f1071636b5cf1 P 330a458f72734b7181bbbca6319781c7: Deleting consensus metadata
I20260808 08:43:43.239609 6584 catalog_manager.cc:4841] TS 330a458f72734b7181bbbca6319781c7 (127.19.242.195:35557): tablet bcf77a7f0c3e4976af2f1071636b5cf1 (table test-table [id=87a5b9df310242b9aabe18b0f1116b2c]) successfully deleted
I20260808 08:43:43.242792 7361 ts_tablet_manager.cc:1918] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:43:43.243080 7361 log.cc:1196] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/bcf77a7f0c3e4976af2f1071636b5cf1
I20260808 08:43:43.243793 7361 ts_tablet_manager.cc:1939] T bcf77a7f0c3e4976af2f1071636b5cf1 P 84494bae45d84ae586311d9331f6ea3e: Deleting consensus metadata
I20260808 08:43:43.243800 7327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.218493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53032 (local address 127.19.242.193:34637)
0808 08:43:43.218746 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:43.218753 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:43.218774 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:43:43.218846 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:43.218852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:43.218933 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:43.219040 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:43.222401 (+ 3361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.225303 (+ 2902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.227514 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.228201 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.228362 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.232758 (+ 4396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:43.232782 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:43.232804 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:43.232875 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:43.238294 (+ 5419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:43.240034 (+ 1740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:43.240045 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:43.240048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:43.240456 (+ 408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:43.241010 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:43.241017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:43.241025 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:43.241553 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:43.241905 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.242985 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.243352 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:43:43.245517 6879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:43.246209 6580 catalog_manager.cc:4841] TS 84494bae45d84ae586311d9331f6ea3e (127.19.242.193:34637): tablet bcf77a7f0c3e4976af2f1071636b5cf1 (table test-table [id=87a5b9df310242b9aabe18b0f1116b2c]) successfully deleted
I20260808 08:43:43.246284 7363 ts_tablet_manager.cc:1918] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:43:43.246661 7363 log.cc:1196] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/bcf77a7f0c3e4976af2f1071636b5cf1
I20260808 08:43:43.247388 7363 ts_tablet_manager.cc:1939] T bcf77a7f0c3e4976af2f1071636b5cf1 P 3cdfbe40874149968b51e5c2d8be890f: Deleting consensus metadata
I20260808 08:43:43.249691 6584 catalog_manager.cc:4841] TS 3cdfbe40874149968b51e5c2d8be890f (127.19.242.194:43667): tablet bcf77a7f0c3e4976af2f1071636b5cf1 (table test-table [id=87a5b9df310242b9aabe18b0f1116b2c]) successfully deleted
I20260808 08:43:43.347960 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 6651
I20260808 08:43:43.373916 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 6888
I20260808 08:43:43.390398 7328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.374880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36108 (local address 127.19.242.194:43667)
0808 08:43:43.375068 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:43.375073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:43.375092 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:43:43.375157 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:43.375161 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:43.375235 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:43.375332 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:43.377047 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.377890 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.379567 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.380036 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.380201 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.383257 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:43.383276 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:43.383294 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:43.383344 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:43.386541 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:43.387810 (+ 1269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:43.387820 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:43.387823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:43.388014 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:43.388525 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:43.388538 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:43.388541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:43.388964 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:43.389349 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.389717 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.389974 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:43:43.391279 7089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:43.484992 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 6888
I20260808 08:43:43.513727 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 7099
I20260808 08:43:43.529167 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:43.514635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60606 (local address 127.19.242.195:35557)
0808 08:43:43.514886 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:43.514892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:43.514915 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:43:43.515098 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:43.515104 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:43.515200 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:43.515319 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:43.516737 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.517684 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.519156 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:43.519562 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:43.519731 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:43.522662 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:43.522677 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:43.522696 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:43.522781 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:43.525789 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:43.526635 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:43.526646 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:43.526650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:43.526917 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:43.527407 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:43.527413 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:43.527416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:43.527844 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:43.528175 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:43.528545 (+ 370us) server_negotiation.cc:299] Negotiation successful
0808 08:43:43.528799 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 08:43:43.529911 7282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:43.625176 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 7099
I20260808 08:43:43.652828 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 6557
I20260808 08:43:43.654201 6640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:43.769404 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 6557
I20260808 08:43:43.802917 20427 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:43:44.149884 20427 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:43:44.150255 20427 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:43:44.508054 20427 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:43:44.508 UTC [5172] LOG: received smart shutdown request
2026-08-08 08:43:44.511 UTC [5172] LOG: background worker "logical replication launcher" (PID 5186) exited with exit code 1
2026-08-08 08:43:44.512 UTC [5178] LOG: shutting down
2026-08-08 08:43:44.685 UTC [5172] LOG: database system is shut down
2026-08-08T08:43:44Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (58466 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:43:44 dist-test-slave-39l8 krb5kdc[7380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:43:44 dist-test-slave-39l8 krb5kdc[7380](info): set up 2 sockets
Aug 08 08:43:44 dist-test-slave-39l8 krb5kdc[7380](info): commencing operation
krb5kdc: starting...
W20260808 08:43:46.171340 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:43:46 dist-test-slave-39l8 krb5kdc[7380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:43:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:43:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:43:46.499049 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43707
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:43707,127.19.242.253:43945,127.19.242.252:39041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:46.867105 7403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:46.867448 7403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:46.867612 7403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:46.875188 7403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:46.875324 7403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:46.875413 7403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:46.875512 7403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:46.875571 7403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:46.886096 7403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:43707,127.19.242.253:43945,127.19.242.252:39041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:46.887626 7403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:46.889004 7403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:46.903288 7413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:46.903260 7414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:46.903203 7417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:46.904641 7403 server_base.cc:1034] running on GCE node
I20260808 08:43:46.905571 7403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:46.907351 7403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:46.908618 7403 hybrid_clock.cc:648] HybridClock initialized: now 1786178626908565 us; error 57 us; skew 500 ppm
I20260808 08:43:46.909029 7403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:46 dist-test-slave-39l8 krb5kdc[7380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:46.912848 7403 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:43:46.914659 7403 webserver.cc:460] Webserver started at http://127.19.242.254:39703/ using document root <none> and password file <none>
I20260808 08:43:46.915524 7403 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:46.915689 7403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:46.916038 7403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:46.919399 7403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "7c0b42a701f041ba9738693077c6eb16"
format_stamp: "Formatted at 2026-08-08 08:43:46 on dist-test-slave-39l8"
server_key: "fa47b681837cf48f6ccd6e133bd410b6"
server_key_iv: "0ffec8f43263bf7593d533c4c093edfd"
server_key_version: "encryptionkey@0"
I20260808 08:43:46.920324 7403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "7c0b42a701f041ba9738693077c6eb16"
format_stamp: "Formatted at 2026-08-08 08:43:46 on dist-test-slave-39l8"
server_key: "fa47b681837cf48f6ccd6e133bd410b6"
server_key_iv: "0ffec8f43263bf7593d533c4c093edfd"
server_key_version: "encryptionkey@0"
I20260808 08:43:46.926170 7403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:43:46.930317 7426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:46.931931 7403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:43:46.932209 7403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "7c0b42a701f041ba9738693077c6eb16"
format_stamp: "Formatted at 2026-08-08 08:43:46 on dist-test-slave-39l8"
server_key: "fa47b681837cf48f6ccd6e133bd410b6"
server_key_iv: "0ffec8f43263bf7593d533c4c093edfd"
server_key_version: "encryptionkey@0"
I20260808 08:43:46.932446 7403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:46.964041 7403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:46.969084 7403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:46.969466 7403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:46.990343 7403 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:43707
I20260808 08:43:46.990379 7498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:43707 every 8 connection(s)
I20260808 08:43:46.992065 7403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:43:46.996335 7499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:47.001801 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 7403
I20260808 08:43:47.002115 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:43:47.002899 20427 external_mini_cluster.cc:1428] Setting key d06d9caba956dea546e7443911fe3a9c
I20260808 08:43:47.004056 7499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:43:47 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:47.032155 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.007982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:43707 (local address 127.0.0.1:35296)
0808 08:43:47.008926 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.008992 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:47.012369 (+ 3377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:47.013519 (+ 1150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:47.013525 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:47.014152 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:47.014533 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.014551 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.016287 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.016296 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.018391 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.018414 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.019600 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.019611 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.019851 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.020649 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:47.020689 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:47.023731 (+ 3042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:47.027499 (+ 3768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.027513 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.027529 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.027982 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.028461 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.028467 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.028471 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.028639 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.029493 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:47.029507 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:47.029734 (+ 227us) client_negotiation.cc:769] Sending connection context
0808 08:43:47.030001 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 08:43:47.030635 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":162,"thread_start_us":402,"threads_started":1}
I20260808 08:43:47.032181 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.009482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35296 (local address 127.19.242.254:43707)
0808 08:43:47.012383 (+ 2901us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:47.012395 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:47.012464 (+ 69us) server_negotiation.cc:407] Connection header received
0808 08:43:47.012821 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:47.012833 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:47.013226 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:47.013478 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:47.014822 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.016085 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.018576 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.019299 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.019450 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.024024 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:47.024034 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:47.024048 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:47.024085 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:47.027322 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.028144 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.028159 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.028162 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.028331 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.028752 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.028769 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.028776 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.029341 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:47.029564 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:47.030123 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 08:43:47.030498 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":2645,"thread_start_us":2444,"threads_started":1}
WARNING: no policy specified for kudu/127.19.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.253@KRBTEST.COM" created.
I20260808 08:43:47.035637 7499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:43:47.037169 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.036682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39648)
0808 08:43:47.036893 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.037019 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260808 08:43:47.037653 7427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
I20260808 08:43:47.039521 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.039131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39650)
0808 08:43:47.039295 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.039384 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:43:47.039770 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43945: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab.
Entry for principal kudu/127.19.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab.
I20260808 08:43:47.072551 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:43945
--webserver_interface=127.19.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab
--principal=kudu/127.19.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:43707,127.19.242.253:43945,127.19.242.252:39041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:43:47.089289 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } attempt: 1
I20260808 08:43:47.090864 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.090210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39656)
0808 08:43:47.090487 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.090632 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 08:43:47.092090 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.091674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39660)
0808 08:43:47.091851 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.091929 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:43:47.092423 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43945: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
I20260808 08:43:47.160746 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } attempt: 2
I20260808 08:43:47.162228 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.161648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39662)
0808 08:43:47.161921 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.162022 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 08:43:47.163528 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.163088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39664)
0808 08:43:47.163256 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.163380 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 08:43:47.163748 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43945: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
I20260808 08:43:47.255134 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } attempt: 3
I20260808 08:43:47.256395 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.255914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39668)
0808 08:43:47.256138 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.256260 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 08:43:47.257861 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.257395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39674)
0808 08:43:47.257615 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.257698 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 08:43:47.258174 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43945: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
I20260808 08:43:47.401501 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } attempt: 4
I20260808 08:43:47.403018 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.402316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39678)
0808 08:43:47.402761 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.402871 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260808 08:43:47.404402 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.403951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39680)
0808 08:43:47.404155 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.404257 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260808 08:43:47.404719 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43945: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43945: connect: Connection refused (error 111)
W20260808 08:43:47.445425 7512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:47.445753 7512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:47.445914 7512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:47.453619 7512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:47.453775 7512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:47.453856 7512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:47.453954 7512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:47.454032 7512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:47.464918 7512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:43707,127.19.242.253:43945,127.19.242.252:39041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab
--principal=kudu/127.19.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:43945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:47.466493 7512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:47.467959 7512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:47.481392 7520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:47.481381 7523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:47.482307 7526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:47.483183 7512 server_base.cc:1034] running on GCE node
I20260808 08:43:47.484293 7512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:47.486443 7512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:47.487715 7512 hybrid_clock.cc:648] HybridClock initialized: now 1786178627487630 us; error 108 us; skew 500 ppm
I20260808 08:43:47.488138 7512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:47 dist-test-slave-39l8 krb5kdc[7380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:47.491802 7512 init.cc:377] Logged in from keytab as kudu/127.19.242.253@KRBTEST.COM (short username kudu)
I20260808 08:43:47.493659 7512 webserver.cc:460] Webserver started at http://127.19.242.253:40845/ using document root <none> and password file <none>
I20260808 08:43:47.494493 7512 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:47.494657 7512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:47.495033 7512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:47.498292 7512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data/instance:
uuid: "90c7ef921ad7483f99999ef14efbe81a"
format_stamp: "Formatted at 2026-08-08 08:43:47 on dist-test-slave-39l8"
server_key: "bf07a876a18ec9d4ef19647a2c47e667"
server_key_iv: "5c93a68f2e76fa20bd1358b216043459"
server_key_version: "encryptionkey@0"
I20260808 08:43:47.499229 7512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/wal/instance:
uuid: "90c7ef921ad7483f99999ef14efbe81a"
format_stamp: "Formatted at 2026-08-08 08:43:47 on dist-test-slave-39l8"
server_key: "bf07a876a18ec9d4ef19647a2c47e667"
server_key_iv: "5c93a68f2e76fa20bd1358b216043459"
server_key_version: "encryptionkey@0"
I20260808 08:43:47.505214 7512 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:43:47.509373 7535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:47.511030 7512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:43:47.511269 7512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/wal
uuid: "90c7ef921ad7483f99999ef14efbe81a"
format_stamp: "Formatted at 2026-08-08 08:43:47 on dist-test-slave-39l8"
server_key: "bf07a876a18ec9d4ef19647a2c47e667"
server_key_iv: "5c93a68f2e76fa20bd1358b216043459"
server_key_version: "encryptionkey@0"
I20260808 08:43:47.511513 7512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:47.528482 7512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:47.533525 7512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:47.533867 7512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:47.555022 7512 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.253:43945
I20260808 08:43:47.555053 7605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.253:43945 every 8 connection(s)
I20260808 08:43:47.556631 7512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
I20260808 08:43:47.560580 7606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:47.566143 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 7512
I20260808 08:43:47.566356 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-1/wal/instance
I20260808 08:43:47.566896 20427 external_mini_cluster.cc:1428] Setting key 952d825c8ba4e3fec5334e50066dcc4d
I20260808 08:43:47.567907 7606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:43:47 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.242.252@KRBTEST.COM; defaulting to no policy
I20260808 08:43:47.597631 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.571376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35304 (local address 127.19.242.254:43707)
0808 08:43:47.571900 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:47.571905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:47.573248 (+ 1343us) server_negotiation.cc:407] Connection header received
0808 08:43:47.575477 (+ 2229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:47.575483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:47.575600 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:47.575737 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:47.577494 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.578223 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.580086 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.580740 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.580947 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.590334 (+ 9387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:47.590341 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:47.590345 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:47.590403 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:47.593541 (+ 3138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.594839 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.594843 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.594846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.594990 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.595602 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.595605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.595607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.595984 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:47.596122 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:47.597135 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0808 08:43:47.597341 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":298,"threads_started":1}
I20260808 08:43:47.598694 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.572091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:43707 (local address 127.0.0.1:35304)
0808 08:43:47.572997 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.573054 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:47.575140 (+ 2086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:47.576028 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:47.576038 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:47.576628 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:47.577268 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.577287 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.578428 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.578432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.579896 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.579912 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.581075 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.581084 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.581353 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.586547 (+ 5194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:47.586608 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:47.589943 (+ 3335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:47.593795 (+ 3852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.593808 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.593833 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.594638 (+ 805us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.595129 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.595134 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.595138 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.595450 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.596133 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:47.596145 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:47.596556 (+ 411us) client_negotiation.cc:769] Sending connection context
0808 08:43:47.596887 (+ 331us) client_negotiation.cc:240] Negotiation successful
0808 08:43:47.597338 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":391,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.252@KRBTEST.COM" created.
I20260808 08:43:47.600855 7606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:43:47 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:43:47.620805 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.601802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39688)
0808 08:43:47.601990 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.602011 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:47.602135 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:47.603656 (+ 1521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:47.603660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:47.604082 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:47.604241 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.604251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.606560 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.606565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.607527 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.607539 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.608994 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.609000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.609423 (+ 423us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.610193 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:47.610213 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:47.613175 (+ 2962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:47.617731 (+ 4556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.617740 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.617746 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.618175 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.618615 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.618620 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.618624 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.618859 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.619586 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:47.619600 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:47.619758 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 08:43:47.619925 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 08:43:47.620266 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":121}
I20260808 08:43:47.620832 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.602135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39688 (local address 127.19.242.253:43945)
0808 08:43:47.603024 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:47.603036 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:47.603084 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:43:47.603154 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:47.603165 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:47.603459 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:47.603644 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:47.604428 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.606370 (+ 1942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.607689 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.608788 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.608974 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.613435 (+ 4461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:47.613450 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:47.613467 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:47.613506 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:47.617538 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.618333 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.618351 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.618354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.618475 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.618976 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.618984 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.618988 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.619442 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:47.619698 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:47.620115 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 08:43:47.620390 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":669,"thread_start_us":463,"threads_started":1}
I20260808 08:43:47.623984 7606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:43:47.625645 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.624914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58066)
0808 08:43:47.625193 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.625357 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260808 08:43:47.626034 7537 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.628234 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.627642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58076)
0808 08:43:47.627880 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.628017 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260808 08:43:47.628526 7606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab.
Entry for principal kudu/127.19.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab.
I20260808 08:43:47.640285 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:39041
--webserver_interface=127.19.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab
--principal=kudu/127.19.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:43707,127.19.242.253:43945,127.19.242.252:39041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:43:47.677906 7606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 1
I20260808 08:43:47.679258 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.678641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58086)
0808 08:43:47.678902 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.679056 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 08:43:47.680447 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.680021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58090)
0808 08:43:47.680210 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.680305 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 08:43:47.680763 7606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.704173 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } attempt: 5
Aug 08 08:43:47 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:43:47.719414 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.705191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39704 (local address 127.19.242.253:43945)
0808 08:43:47.705418 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:47.705424 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:47.705446 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:43:47.705577 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:47.705581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:47.705646 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:47.705758 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:47.706571 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.707327 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.708562 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.709047 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.709197 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.713036 (+ 3839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:47.713052 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:47.713056 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:47.713098 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:47.716432 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.717309 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.717319 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.717322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.717454 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:47.717879 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:47.717884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:47.717888 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:47.718198 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:47.718364 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:47.718802 (+ 438us) server_negotiation.cc:299] Negotiation successful
0808 08:43:47.719034 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:43:47.719422 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.705010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39704)
0808 08:43:47.705239 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.705280 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:47.705422 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:47.705799 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:47.705808 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:47.706225 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:47.706387 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.706396 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.707469 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.707475 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.708401 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:47.708414 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:47.709209 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:47.709215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:47.709424 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:47.710225 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:47.710244 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:47.712756 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:47.716616 (+ 3860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.716623 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.716627 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.717156 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.717584 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:47.717590 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:47.717593 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:47.717759 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:47.718325 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:47.718331 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:47.718499 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 08:43:47.718667 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:43:47.719040 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 08:43:47.720803 7499 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:43:47.722235 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.721749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58100)
0808 08:43:47.721932 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.722077 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 08:43:47.723627 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.723168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58104)
0808 08:43:47.723409 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.723502 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 08:43:47.723963 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.749025 7606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 2
I20260808 08:43:47.750408 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.749777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58108)
0808 08:43:47.750039 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.750182 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 08:43:47.751832 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.751362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58112)
0808 08:43:47.751541 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.751645 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 08:43:47.752189 7606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.775272 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 1
I20260808 08:43:47.776726 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.776153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58124)
0808 08:43:47.776387 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.776507 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 08:43:47.777925 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.777513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58134)
0808 08:43:47.777702 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.777785 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:43:47.778182 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.843477 7606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 3
I20260808 08:43:47.844869 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.844227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58144)
0808 08:43:47.844502 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.844649 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 08:43:47.846228 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.845658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58160)
0808 08:43:47.845925 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.846042 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260808 08:43:47.846556 7606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.846431 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 2
I20260808 08:43:47.847689 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.847189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58174)
0808 08:43:47.847418 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.847515 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:43:47.848793 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.848377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58180)
0808 08:43:47.848549 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.848661 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:43:47.849015 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.955302 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 3
I20260808 08:43:47.956512 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.956023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58194)
0808 08:43:47.956247 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.956346 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 08:43:47.957616 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.957209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58208)
0808 08:43:47.957440 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.957510 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260808 08:43:47.957854 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:47.989876 7606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 4
I20260808 08:43:47.991400 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.990731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58222)
0808 08:43:47.991025 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.991168 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 08:43:47.992759 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:47.992329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58228)
0808 08:43:47.992509 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:47.992608 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:43:47.993137 7606 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
W20260808 08:43:48.032502 7618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:48.032908 7618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:48.033105 7618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:48.041539 7618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:48.041713 7618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:48.041824 7618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:48.041930 7618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:48.042009 7618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:48.052636 7618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:43707,127.19.242.253:43945,127.19.242.252:39041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab
--principal=kudu/127.19.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:39041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:48.054173 7618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:48.055617 7618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:48.068580 7630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:48.068673 7628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:48.068655 7624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:48.069871 7618 server_base.cc:1034] running on GCE node
I20260808 08:43:48.071062 7618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:48.072844 7618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:48.074147 7618 hybrid_clock.cc:648] HybridClock initialized: now 1786178628074098 us; error 76 us; skew 500 ppm
I20260808 08:43:48.074605 7618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178628, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:48.078492 7618 init.cc:377] Logged in from keytab as kudu/127.19.242.252@KRBTEST.COM (short username kudu)
I20260808 08:43:48.080470 7618 webserver.cc:460] Webserver started at http://127.19.242.252:34419/ using document root <none> and password file <none>
I20260808 08:43:48.081429 7618 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:48.081612 7618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:48.081995 7618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:48.085701 7618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data/instance:
uuid: "429482bd32044f5fa4ae9d84e4fdff96"
format_stamp: "Formatted at 2026-08-08 08:43:48 on dist-test-slave-39l8"
server_key: "27b83b1f4010a0e9df0a4f670eebfef1"
server_key_iv: "14ff18b2835318755d49ce251a2a9f03"
server_key_version: "encryptionkey@0"
I20260808 08:43:48.086760 7618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/wal/instance:
uuid: "429482bd32044f5fa4ae9d84e4fdff96"
format_stamp: "Formatted at 2026-08-08 08:43:48 on dist-test-slave-39l8"
server_key: "27b83b1f4010a0e9df0a4f670eebfef1"
server_key_iv: "14ff18b2835318755d49ce251a2a9f03"
server_key_version: "encryptionkey@0"
I20260808 08:43:48.093315 7618 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260808 08:43:48.097792 7647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:48.099594 7618 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:48.099836 7618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/wal
uuid: "429482bd32044f5fa4ae9d84e4fdff96"
format_stamp: "Formatted at 2026-08-08 08:43:48 on dist-test-slave-39l8"
server_key: "27b83b1f4010a0e9df0a4f670eebfef1"
server_key_iv: "14ff18b2835318755d49ce251a2a9f03"
server_key_version: "encryptionkey@0"
I20260808 08:43:48.100073 7618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:48.115075 7618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:48.120407 7618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:48.120760 7618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:48.135145 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 4
I20260808 08:43:48.136529 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.136043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58242)
0808 08:43:48.136280 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:48.136382 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 08:43:48.137925 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.137499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58258)
0808 08:43:48.137685 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:48.137790 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:43:48.138252 7499 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:39041: Network error: Client connection negotiation failed: client connection to 127.19.242.252:39041: connect: Connection refused (error 111)
I20260808 08:43:48.142613 7618 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.252:39041
I20260808 08:43:48.142637 7721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.252:39041 every 8 connection(s)
I20260808 08:43:48.144367 7618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
I20260808 08:43:48.148746 7723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:48.152683 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 7618
I20260808 08:43:48.152920 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178398071314-20427-0/minicluster-data/master-2/wal/instance
I20260808 08:43:48.153457 20427 external_mini_cluster.cc:1428] Setting key 0d9211356a3a8ac3f520654d24c1d4db
I20260808 08:43:48.157033 7723 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178628, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:48.183041 7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.161828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35318 (local address 127.19.242.254:43707)
0808 08:43:48.162474 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.162480 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.164918 (+ 2438us) server_negotiation.cc:407] Connection header received
0808 08:43:48.165162 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.165167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.165244 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.165372 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.167016 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.168156 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.169697 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.170413 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.170525 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.175287 (+ 4762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.175297 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.175303 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.175358 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.179441 (+ 4083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.180428 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.180433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.180435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.180627 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.181102 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.181107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.181109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.181499 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.181706 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.182258 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.182508 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":318,"threads_started":1}
I20260808 08:43:48.183157 7726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.155806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58270 (local address 127.19.242.252:39041)
0808 08:43:48.156729 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.156758 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.156814 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:43:48.159344 (+ 2530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.159380 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.159994 (+ 614us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.160458 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.162425 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.163890 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.165644 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.166797 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.167030 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.172505 (+ 5475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.172534 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.172554 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.172596 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.177115 (+ 4519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.178297 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.178308 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.178320 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.178589 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.179196 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.179203 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.179207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.180060 (+ 853us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.180438 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.181066 (+ 628us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.181582 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":408,"threads_started":1}
I20260808 08:43:48.183475 7728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.161771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:43707 (local address 127.0.0.1:35318)
0808 08:43:48.164772 (+ 3001us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:48.164820 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:48.165009 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:48.165465 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:48.165475 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:48.166418 (+ 943us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:48.166830 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.166844 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.168366 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.168371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.169496 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.169520 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.170783 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.170799 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.171035 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.171842 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:48.171868 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:48.174967 (+ 3099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:48.179634 (+ 4667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.179646 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.179653 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.180241 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.180773 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.180779 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.180785 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.180943 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.181673 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:48.181683 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:48.181899 (+ 216us) client_negotiation.cc:769] Sending connection context
0808 08:43:48.182133 (+ 234us) client_negotiation.cc:240] Negotiation successful
0808 08:43:48.182501 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2547,"thread_start_us":2416,"threads_started":1}
I20260808 08:43:48.185333 7723 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178628, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:48.203231 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.186205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39712 (local address 127.19.242.253:43945)
0808 08:43:48.186442 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.186451 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.186773 (+ 322us) server_negotiation.cc:407] Connection header received
0808 08:43:48.187043 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.187050 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.187148 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.187247 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.188583 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.189520 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.191249 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.191698 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.191818 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.196064 (+ 4246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.196071 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.196074 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.196114 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.199852 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.200886 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.200892 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.200896 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.201104 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.201560 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.201566 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.201570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.201960 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.202133 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.202678 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.202952 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:43:48.203414 7728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.186205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43945 (local address 127.0.0.1:39712)
0808 08:43:48.186624 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:48.186643 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:48.186844 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:48.187494 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:48.187497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:48.188103 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:48.188381 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.188395 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.189694 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.189698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.191072 (+ 1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.191091 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.191890 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.191897 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.192178 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.192929 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:48.192960 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:48.195796 (+ 2836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:48.200069 (+ 4273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.200075 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.200078 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.200702 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.201257 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.201261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.201263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.201414 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.202123 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:48.202127 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:48.202371 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 08:43:48.202572 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 08:43:48.202948 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277}
I20260808 08:43:48.204762 7723 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:43:48.205827 7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.186873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35334 (local address 127.19.242.254:43707)
0808 08:43:48.187048 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.187053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.187250 (+ 197us) server_negotiation.cc:407] Connection header received
0808 08:43:48.187392 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.187396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.187476 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.187575 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.189349 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.190253 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.192071 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.192623 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.192775 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.198378 (+ 5603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.198387 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.198394 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.198448 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.202133 (+ 3685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.203348 (+ 1215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.203355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.203359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.203537 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.204086 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.204097 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.204100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.204463 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.204836 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.205204 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.205466 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178628, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:43:48.220738 7726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.205732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58278 (local address 127.19.242.252:39041)
0808 08:43:48.205978 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.205985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.206074 (+ 89us) server_negotiation.cc:407] Connection header received
0808 08:43:48.206274 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.206281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.206384 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.206501 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.207503 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.208389 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.209718 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.210473 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.210652 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.214973 (+ 4321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.214978 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.214981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.215011 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.218004 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.218757 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.218762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.218765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.218882 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.219269 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.219275 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.219279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.219569 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.219740 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.220091 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.220336 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260808 08:43:48.220883 7728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.205649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58278)
0808 08:43:48.205976 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:48.205997 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:48.206141 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:48.206562 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:48.206566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:48.207125 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:48.207339 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.207350 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.208525 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.208533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.209512 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.209527 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.210772 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.210780 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.211129 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.211837 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:48.211863 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:48.214763 (+ 2900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:48.218172 (+ 3409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.218178 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.218182 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.218565 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.219001 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.219008 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.219014 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.219156 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.219697 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:48.219702 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:48.219852 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 08:43:48.220011 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 08:43:48.220511 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":144}
I20260808 08:43:48.226305 7723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96: Bootstrap starting.
I20260808 08:43:48.226467 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.208017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39720 (local address 127.19.242.253:43945)
0808 08:43:48.208219 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.208224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.208245 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:43:48.208389 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.208394 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.208500 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.208605 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.210740 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.211990 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.213369 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.214117 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.214231 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.219958 (+ 5727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.219965 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.219969 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.220013 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.223426 (+ 3413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.224288 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.224296 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.224304 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.224459 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.224881 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.224886 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.224891 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.225195 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.225489 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.225807 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.226054 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:43:48.230489 7723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:48.231725 7723 log.cc:824] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:48.232344 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:43:48.234859 7723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96: No bootstrap required, opened a new log
I20260808 08:43:48.247057 7723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.247786 7723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:48.248011 7723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429482bd32044f5fa4ae9d84e4fdff96, State: Initialized, Role: FOLLOWER
I20260808 08:43:48.249039 7723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.256567 7742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.258860 7742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:43:48.259132 7723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:43:48.261018 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.238123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39732 (local address 127.19.242.253:43945)
0808 08:43:48.238330 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.238339 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.239019 (+ 680us) server_negotiation.cc:407] Connection header received
0808 08:43:48.239118 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.239123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.239212 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.239315 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.242172 (+ 2857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.243391 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.245785 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.246439 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.246558 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.251261 (+ 4703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.251273 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.251281 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.251361 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.256440 (+ 5079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.257632 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.257640 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.257644 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.257840 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.258356 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.258364 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.258369 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.258971 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.259258 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.260234 (+ 976us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.260599 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:43:48.268487 7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.237803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35348 (local address 127.19.242.254:43707)
0808 08:43:48.238012 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.238019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.245433 (+ 7414us) server_negotiation.cc:407] Connection header received
0808 08:43:48.246125 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.246135 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.246252 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.246352 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.249429 (+ 3077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.250625 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.252913 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.253624 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.253734 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.260202 (+ 6468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.260210 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.260215 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.260272 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.264568 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.265747 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.265755 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.265760 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.265935 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.266594 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.266601 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.266604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.267009 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.267260 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.267881 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.268126 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:43:48.269923 7726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.239133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58282 (local address 127.19.242.252:39041)
0808 08:43:48.239363 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.239371 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.248893 (+ 9522us) server_negotiation.cc:407] Connection header received
0808 08:43:48.249463 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.249469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.249569 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.249644 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.251830 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.252962 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.255265 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.256140 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.256291 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.261105 (+ 4814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.261115 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.261123 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.261187 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.265796 (+ 4609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.266801 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.266811 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.266817 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.267075 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.267547 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.267553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.267558 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.268128 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.268500 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.269262 (+ 762us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.269527 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 08:43:48.280690 7758 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:43:48.280884 7758 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:43:48.278349 7618 master_runner.cc:186] Error getting master registration for 127.19.242.254:43707: OK, instance_id { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" instance_seqno: 1786178626984499 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:43:48.288604 7618 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:43:48.292387 7606 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 5
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
I20260808 08:43:48.311362 7726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.293482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58288 (local address 127.19.242.252:39041)
0808 08:43:48.293678 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.293684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.293705 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:43:48.293906 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.293912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.293996 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.294101 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.295421 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.296356 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.298370 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.299059 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.299188 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.304080 (+ 4892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.304085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.304089 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.304131 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.307860 (+ 3729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.308888 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.308893 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.308895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.309052 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.309641 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.309646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.309648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.309999 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.310183 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.310687 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.311003 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:43:48.311506 7610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.293113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58288)
0808 08:43:48.293534 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:48.293562 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:48.293689 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:48.294310 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:48.294316 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:48.294988 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:48.295232 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.295248 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.296537 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.296544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.298161 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.298181 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.299273 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.299281 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.299550 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.300344 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:48.300372 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:48.303873 (+ 3501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:48.308063 (+ 4190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.308071 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.308075 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.308719 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.309201 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.309207 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.309212 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.309456 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.310139 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:48.310145 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:48.310338 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 08:43:48.310535 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 08:43:48.310992 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257}
I20260808 08:43:48.318435 7606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: Bootstrap starting.
I20260808 08:43:48.323315 7606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:48.324903 7606 log.cc:824] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:48.329172 7606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: No bootstrap required, opened a new log
I20260808 08:43:48.342094 7606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.342597 7606 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:48.342772 7606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c7ef921ad7483f99999ef14efbe81a, State: Initialized, Role: FOLLOWER
I20260808 08:43:48.343511 7606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.344767 7763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.345189 7763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:43:48.346297 7606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:43:48.360057 7778 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:43:48.360334 7778 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:43:48.356531 7512 master_runner.cc:186] Error getting master registration for 127.19.242.254:43707: OK, instance_id { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" instance_seqno: 1786178626984499 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:43:48.369483 7512 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 08:43:48.373267 7653 tablet.cc:2369] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:43:48.415524 7499 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } attempt: 5
Aug 08 08:43:48 dist-test-slave-39l8 krb5kdc[7380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178626, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
I20260808 08:43:48.430734 7501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.416358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:39041 (local address 127.0.0.1:58290)
0808 08:43:48.416642 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:48.416663 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:48.416818 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:48.417215 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:48.417223 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:48.417657 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:48.417834 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.417843 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.418984 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.418991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.420149 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:48.420172 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.420960 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.420966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:48.421168 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.421900 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:48.421919 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:48.424200 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:48.427745 (+ 3545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.427752 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.427756 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.428254 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.428691 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:48.428697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:48.428700 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:48.428857 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:48.429559 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:48.429564 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:48.429767 (+ 203us) client_negotiation.cc:769] Sending connection context
0808 08:43:48.429936 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 08:43:48.430271 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170}
I20260808 08:43:48.431921 7726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:48.416423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58290 (local address 127.19.242.252:39041)
0808 08:43:48.416645 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:48.416652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:48.416739 (+ 87us) server_negotiation.cc:407] Connection header received
0808 08:43:48.416978 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:48.416983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:48.417060 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:48.417172 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:48.417997 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.418832 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.420308 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:48.420791 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:48.420932 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:48.424448 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:48.424455 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:48.424458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:48.424503 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:48.427579 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.428397 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.428403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.428412 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.428549 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:48.428978 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:48.428984 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:48.428989 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:48.429337 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:48.429486 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:48.431212 (+ 1726us) server_negotiation.cc:299] Negotiation successful
0808 08:43:48.431499 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:43:48.438364 7499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: Bootstrap starting.
I20260808 08:43:48.441695 7499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:48.442975 7499 log.cc:824] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:48.445940 7499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: No bootstrap required, opened a new log
I20260808 08:43:48.456215 7499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.456619 7499 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:48.456751 7499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c0b42a701f041ba9738693077c6eb16, State: Initialized, Role: FOLLOWER
I20260808 08:43:48.457445 7499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.458513 7781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.459036 7781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:43:48.459978 7499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:43:48.473047 7433 tablet.cc:2369] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:43:48.479368 7403 master_runner.cc:263] No leader master found from master 7c0b42a701f041ba9738693077c6eb16
I20260808 08:43:48.479609 7403 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 08:43:48.485483 7798 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:43:48.485785 7798 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:43:48.516922 7742 raft_consensus.cc:482] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:43:48.517349 7742 raft_consensus.cc:504] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.519321 7742 leader_election.cc:288] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c0b42a701f041ba9738693077c6eb16 (127.19.242.254:43707), 90c7ef921ad7483f99999ef14efbe81a (127.19.242.253:43945)
I20260808 08:43:48.520802 7569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "429482bd32044f5fa4ae9d84e4fdff96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c7ef921ad7483f99999ef14efbe81a" is_pre_election: true
I20260808 08:43:48.521487 7569 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429482bd32044f5fa4ae9d84e4fdff96 in term 0.
I20260808 08:43:48.523001 7463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "429482bd32044f5fa4ae9d84e4fdff96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c0b42a701f041ba9738693077c6eb16" is_pre_election: true
I20260808 08:43:48.523694 7463 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429482bd32044f5fa4ae9d84e4fdff96 in term 0.
I20260808 08:43:48.524721 7648 leader_election.cc:302] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429482bd32044f5fa4ae9d84e4fdff96, 90c7ef921ad7483f99999ef14efbe81a; no voters:
I20260808 08:43:48.530584 7742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:43:48.530913 7742 raft_consensus.cc:482] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:43:48.531061 7742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:48.535735 7742 raft_consensus.cc:504] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
W20260808 08:43:48.537324 7541 tablet.cc:2369] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:43:48.537575 7463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "429482bd32044f5fa4ae9d84e4fdff96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c0b42a701f041ba9738693077c6eb16"
I20260808 08:43:48.537832 7463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:48.541635 7463 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429482bd32044f5fa4ae9d84e4fdff96 in term 1.
I20260808 08:43:48.542356 7651 leader_election.cc:302] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429482bd32044f5fa4ae9d84e4fdff96, 7c0b42a701f041ba9738693077c6eb16; no voters:
I20260808 08:43:48.546072 7569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "429482bd32044f5fa4ae9d84e4fdff96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c7ef921ad7483f99999ef14efbe81a"
I20260808 08:43:48.546406 7569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:48.550210 7569 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429482bd32044f5fa4ae9d84e4fdff96 in term 1.
I20260808 08:43:48.551427 7742 leader_election.cc:288] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [CANDIDATE]: Term 1 election: Requested vote from peers 7c0b42a701f041ba9738693077c6eb16 (127.19.242.254:43707), 90c7ef921ad7483f99999ef14efbe81a (127.19.242.253:43945)
I20260808 08:43:48.552037 7742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:43:48.552632 7742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [term 1 LEADER]: Becoming Leader. State: Replica: 429482bd32044f5fa4ae9d84e4fdff96, State: Running, Role: LEADER
I20260808 08:43:48.556977 7742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } }
I20260808 08:43:48.572453 7801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 429482bd32044f5fa4ae9d84e4fdff96. Latest consensus state: current_term: 1 leader_uuid: "429482bd32044f5fa4ae9d84e4fdff96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.573211 7801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:48.580369 7803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:43:48.583297 7803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:43:48.604962 7569 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [term 1 FOLLOWER]: Refusing update from remote peer 429482bd32044f5fa4ae9d84e4fdff96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:43:48.606316 7801 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:43:48.614074 7463 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [term 1 FOLLOWER]: Refusing update from remote peer 429482bd32044f5fa4ae9d84e4fdff96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:43:48.615317 7801 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:43:48.653363 7781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 429482bd32044f5fa4ae9d84e4fdff96. Latest consensus state: current_term: 1 leader_uuid: "429482bd32044f5fa4ae9d84e4fdff96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.653754 7781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:43:48.660951 7804 mvcc.cc:205] Tried to move back new op lower bound from 7316187662751567872 to 7316187662584594432. Current Snapshot: MvccSnapshot[applied={T|T < 7316187662751567872}]
I20260808 08:43:48.666241 7807 mvcc.cc:205] Tried to move back new op lower bound from 7316187662751567872 to 7316187662584594432. Current Snapshot: MvccSnapshot[applied={T|T < 7316187662751567872}]
I20260808 08:43:48.667333 7781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "429482bd32044f5fa4ae9d84e4fdff96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.667623 7781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:43:48.674638 7763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 429482bd32044f5fa4ae9d84e4fdff96. Latest consensus state: current_term: 1 leader_uuid: "429482bd32044f5fa4ae9d84e4fdff96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.675045 7763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:43:48.678083 7742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "429482bd32044f5fa4ae9d84e4fdff96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.678467 7742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:48.684478 7801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "429482bd32044f5fa4ae9d84e4fdff96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.685467 7801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:48.686757 7805 mvcc.cc:205] Tried to move back new op lower bound from 7316187662751567872 to 7316187662584594432. Current Snapshot: MvccSnapshot[applied={T|T < 7316187662751567872}]
I20260808 08:43:48.694296 7803 catalog_manager.cc:1347] Generated new cluster ID: edd2cb2809fc4b81a05063f5f3f7e8c1
I20260808 08:43:48.694437 7803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:43:48.707197 7763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "429482bd32044f5fa4ae9d84e4fdff96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c0b42a701f041ba9738693077c6eb16" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43707 } } peers { permanent_uuid: "90c7ef921ad7483f99999ef14efbe81a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43945 } } peers { permanent_uuid: "429482bd32044f5fa4ae9d84e4fdff96" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 39041 } } }
I20260808 08:43:48.707499 7763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:43:48.722995 7803 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:43:48.725126 7803 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:43:48.749009 7803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 429482bd32044f5fa4ae9d84e4fdff96: Generated new TSK 0
I20260808 08:43:48.750377 7803 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:43:49.362849 7778 catalog_manager.cc:1259] Loaded cluster ID: edd2cb2809fc4b81a05063f5f3f7e8c1
I20260808 08:43:49.362957 7778 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: loading cluster ID for follower catalog manager: success
I20260808 08:43:49.365839 7778 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: acquiring CA information for follower catalog manager: success
I20260808 08:43:49.367976 7778 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 90c7ef921ad7483f99999ef14efbe81a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:43:49.488003 7798 catalog_manager.cc:1259] Loaded cluster ID: edd2cb2809fc4b81a05063f5f3f7e8c1
I20260808 08:43:49.488117 7798 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: loading cluster ID for follower catalog manager: success
I20260808 08:43:49.490584 7798 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: acquiring CA information for follower catalog manager: success
I20260808 08:43:49.492631 7798 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7c0b42a701f041ba9738693077c6eb16: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:43:49.900216 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 7403
I20260808 08:43:49.901940 7490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:50.020551 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 7403
I20260808 08:43:50.050776 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 7512
I20260808 08:43:50.052146 7599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:50.164839 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 7512
I20260808 08:43:50.195798 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 7618
I20260808 08:43:50.197014 7717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:50.310379 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 7618
2026-08-08T08:43:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5497 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:43:50 dist-test-slave-39l8 krb5kdc[7831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:43:50 dist-test-slave-39l8 krb5kdc[7831](info): set up 2 sockets
Aug 08 08:43:50 dist-test-slave-39l8 krb5kdc[7831](info): commencing operation
krb5kdc: starting...
W20260808 08:43:51.648772 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.008s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:43:51 dist-test-slave-39l8 krb5kdc[7831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:43:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:43:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:43:51.974612 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:38505
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:40985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:38505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:52.371269 7856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:52.371683 7856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:52.371860 7856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:52.379979 7856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:52.380168 7856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:52.380295 7856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:52.380405 7856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:52.380488 7856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:52.391355 7856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:40985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:38505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:38505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:52.392925 7856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:52.394449 7856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:52.408200 7861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:52.408248 7865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:52.408265 7862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:52.409260 7856 server_base.cc:1034] running on GCE node
I20260808 08:43:52.410176 7856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:52.411907 7856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:52.413162 7856 hybrid_clock.cc:648] HybridClock initialized: now 1786178632413059 us; error 90 us; skew 500 ppm
I20260808 08:43:52.413584 7856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:52 dist-test-slave-39l8 krb5kdc[7831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178632, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:52.417214 7856 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:43:52.419080 7856 webserver.cc:460] Webserver started at http://127.19.242.254:44459/ using document root <none> and password file <none>
I20260808 08:43:52.419842 7856 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:52.419960 7856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:52.420258 7856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:52.423669 7856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "83c02ea6cee04304af6d7a73cd66ec54"
format_stamp: "Formatted at 2026-08-08 08:43:52 on dist-test-slave-39l8"
server_key: "cce72e4097a3d742dee02d679d94774d"
server_key_iv: "7e231209aa025e4f4268b33dab10b977"
server_key_version: "encryptionkey@0"
I20260808 08:43:52.424517 7856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "83c02ea6cee04304af6d7a73cd66ec54"
format_stamp: "Formatted at 2026-08-08 08:43:52 on dist-test-slave-39l8"
server_key: "cce72e4097a3d742dee02d679d94774d"
server_key_iv: "7e231209aa025e4f4268b33dab10b977"
server_key_version: "encryptionkey@0"
I20260808 08:43:52.430634 7856 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:43:52.435181 7877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:52.436954 7856 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:43:52.437302 7856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "83c02ea6cee04304af6d7a73cd66ec54"
format_stamp: "Formatted at 2026-08-08 08:43:52 on dist-test-slave-39l8"
server_key: "cce72e4097a3d742dee02d679d94774d"
server_key_iv: "7e231209aa025e4f4268b33dab10b977"
server_key_version: "encryptionkey@0"
I20260808 08:43:52.437551 7856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:52.465363 7856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:52.471038 7856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:52.471428 7856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:52.494259 7856 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:38505
I20260808 08:43:52.494300 7949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:38505 every 8 connection(s)
I20260808 08:43:52.495930 7856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:43:52.499816 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 7856
I20260808 08:43:52.500077 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:43:52.500506 7950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:52.500836 20427 external_mini_cluster.cc:1428] Setting key e6cd046abd89fd68f4ca074db7be5d67
I20260808 08:43:52.516538 7950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54: Bootstrap starting.
Aug 08 08:43:52 dist-test-slave-39l8 krb5kdc[7831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178631, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:52.520910 7950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:52.522397 7950 log.cc:824] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:52.526502 7950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54: No bootstrap required, opened a new log
I20260808 08:43:52.528384 7955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:52.502991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33480 (local address 127.19.242.254:38505)
0808 08:43:52.503961 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:52.503979 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:52.504035 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:43:52.506021 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:52.506054 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:52.506634 (+ 580us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:52.507145 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:52.508676 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:52.510764 (+ 2088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:52.512341 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:52.513571 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:52.513804 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:52.518530 (+ 4726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:52.518544 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:52.518584 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:52.518653 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:52.522885 (+ 4232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:52.524083 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:52.524094 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:52.524104 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:52.524375 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:52.524811 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:52.524816 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:52.524820 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:52.525612 (+ 792us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:52.525932 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:52.526337 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 08:43:52.526865 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":400,"threads_started":1}
I20260808 08:43:52.533020 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:43:52.536741 7950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83c02ea6cee04304af6d7a73cd66ec54" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 38505 } }
I20260808 08:43:52.537221 7950 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:52.537340 7950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c02ea6cee04304af6d7a73cd66ec54, State: Initialized, Role: FOLLOWER
I20260808 08:43:52.538074 7950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83c02ea6cee04304af6d7a73cd66ec54" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 38505 } }
I20260808 08:43:52.538316 7950 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:43:52.538478 7950 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:43:52.538676 7950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:52.541078 7950 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83c02ea6cee04304af6d7a73cd66ec54" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 38505 } }
I20260808 08:43:52.541707 7950 leader_election.cc:302] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83c02ea6cee04304af6d7a73cd66ec54; no voters:
I20260808 08:43:52.542383 7950 leader_election.cc:288] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:43:52.542582 7958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:43:52.543398 7958 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [term 1 LEADER]: Becoming Leader. State: Replica: 83c02ea6cee04304af6d7a73cd66ec54, State: Running, Role: LEADER
I20260808 08:43:52.543968 7958 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83c02ea6cee04304af6d7a73cd66ec54" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 38505 } }
I20260808 08:43:52.544672 7950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:43:52.547113 7959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83c02ea6cee04304af6d7a73cd66ec54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83c02ea6cee04304af6d7a73cd66ec54" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 38505 } } }
I20260808 08:43:52.547214 7960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83c02ea6cee04304af6d7a73cd66ec54. Latest consensus state: current_term: 1 leader_uuid: "83c02ea6cee04304af6d7a73cd66ec54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83c02ea6cee04304af6d7a73cd66ec54" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 38505 } } }
I20260808 08:43:52.547634 7960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:52.548189 7959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:52.550119 7967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:43:52.556282 7967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:43:52.566771 7967 catalog_manager.cc:1347] Generated new cluster ID: 6aa41267fad0468eb9584ab261d2ca45
I20260808 08:43:52.566915 7967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:43:52.600317 7967 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:43:52.602248 7967 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:43:52.614177 7967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83c02ea6cee04304af6d7a73cd66ec54: Generated new TSK 0
I20260808 08:43:52.615235 7967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:43:52.648167 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 7856
I20260808 08:43:52.649668 7943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:52.749732 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 7856
2026-08-08T08:43:52Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2438 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:43:52 dist-test-slave-39l8 krb5kdc[7985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:43:52 dist-test-slave-39l8 krb5kdc[7985](info): set up 2 sockets
Aug 08 08:43:52 dist-test-slave-39l8 krb5kdc[7985](info): commencing operation
krb5kdc: starting...
W20260808 08:43:54.123319 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:43:54 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:43:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:43:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:43:54.455278 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36009
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:54.833732 8008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:54.834218 8008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:54.834407 8008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:54.842133 8008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:54.842335 8008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:54.842432 8008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:54.842522 8008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:54.842594 8008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:54.853221 8008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:54.854803 8008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:54.856292 8008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:54.869606 8016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:54.869637 8017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:54.869557 8020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:54.870481 8008 server_base.cc:1034] running on GCE node
I20260808 08:43:54.871469 8008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:54.873168 8008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:54.874450 8008 hybrid_clock.cc:648] HybridClock initialized: now 1786178634874417 us; error 57 us; skew 500 ppm
I20260808 08:43:54.874969 8008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:54 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178634, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:54.879029 8008 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:43:54.880986 8008 webserver.cc:460] Webserver started at http://127.19.242.254:35061/ using document root <none> and password file <none>
I20260808 08:43:54.881904 8008 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:54.882027 8008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:54.882319 8008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:54.886083 8008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "7083e294617e45778ebca11786df8955"
format_stamp: "Formatted at 2026-08-08 08:43:54 on dist-test-slave-39l8"
server_key: "f3d2d12d2d8819bc85cc53a4c0234227"
server_key_iv: "5ef8ffd69a16b5bc15cc91c5c05d43ec"
server_key_version: "encryptionkey@0"
I20260808 08:43:54.887077 8008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "7083e294617e45778ebca11786df8955"
format_stamp: "Formatted at 2026-08-08 08:43:54 on dist-test-slave-39l8"
server_key: "f3d2d12d2d8819bc85cc53a4c0234227"
server_key_iv: "5ef8ffd69a16b5bc15cc91c5c05d43ec"
server_key_version: "encryptionkey@0"
I20260808 08:43:54.893512 8008 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:43:54.897975 8029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:54.899895 8008 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:54.900104 8008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "7083e294617e45778ebca11786df8955"
format_stamp: "Formatted at 2026-08-08 08:43:54 on dist-test-slave-39l8"
server_key: "f3d2d12d2d8819bc85cc53a4c0234227"
server_key_iv: "5ef8ffd69a16b5bc15cc91c5c05d43ec"
server_key_version: "encryptionkey@0"
I20260808 08:43:54.900398 8008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:54.936906 8008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:54.942164 8008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:54.942521 8008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:54.963454 8008 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36009
I20260808 08:43:54.963493 8100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36009 every 8 connection(s)
I20260808 08:43:54.965065 8008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:43:54.969852 8103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:54.970068 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 8008
I20260808 08:43:54.970314 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:43:54.971289 20427 external_mini_cluster.cc:1428] Setting key d9f8fb0707a23396afe6798eea09680d
I20260808 08:43:54.986181 8103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Bootstrap starting.
Aug 08 08:43:54 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:54.989725 8103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:54.991331 8103 log.cc:824] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:54.995683 8103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: No bootstrap required, opened a new log
I20260808 08:43:55.000948 8107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:54.974191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40522 (local address 127.19.242.254:36009)
0808 08:43:54.975352 (+ 1161us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:54.975370 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:54.975443 (+ 73us) server_negotiation.cc:407] Connection header received
0808 08:43:54.977621 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:54.977675 (+ 54us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:54.978309 (+ 634us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:54.978863 (+ 554us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:54.980448 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:54.982557 (+ 2109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:54.984069 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:54.985237 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:54.985429 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:54.990182 (+ 4753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:54.990202 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:54.990228 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:54.990299 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:54.994915 (+ 4616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:54.996156 (+ 1241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:54.996168 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:54.996181 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:54.996461 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:54.997001 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:54.997008 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:54.997011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:54.997817 (+ 806us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:54.998201 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:54.998789 (+ 588us) server_negotiation.cc:299] Negotiation successful
0808 08:43:54.999363 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":855,"thread_start_us":563,"threads_started":1}
I20260808 08:43:55.006546 8103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:55.007102 8103 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:55.007206 8103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7083e294617e45778ebca11786df8955, State: Initialized, Role: FOLLOWER
I20260808 08:43:55.007807 8103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:55.008026 8103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:43:55.008143 8103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:43:55.008349 8103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:55.011185 8103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:55.011813 8103 leader_election.cc:302] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7083e294617e45778ebca11786df8955; no voters:
I20260808 08:43:55.012626 8103 leader_election.cc:288] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:43:55.012745 8109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:43:55.014133 8109 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 LEADER]: Becoming Leader. State: Replica: 7083e294617e45778ebca11786df8955, State: Running, Role: LEADER
I20260808 08:43:55.014806 8109 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:55.015545 8103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:43:55.017976 8112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7083e294617e45778ebca11786df8955. Latest consensus state: current_term: 1 leader_uuid: "7083e294617e45778ebca11786df8955" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } } }
I20260808 08:43:55.018898 8110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7083e294617e45778ebca11786df8955" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } } }
I20260808 08:43:55.019309 8110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:55.018867 8112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:55.022843 8121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:43:55.029114 8121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:43:55.039430 8121 catalog_manager.cc:1347] Generated new cluster ID: 274ce40dcb3e4ef29f7af7f391b2ff5d
I20260808 08:43:55.039569 8121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:43:55.058688 8121 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:43:55.060540 8121 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:43:55.069537 8121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Generated new TSK 0
I20260808 08:43:55.070555 8121 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:43:55.154655 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36009
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:55.537537 8138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:55.537854 8138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:55.538023 8138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:55.545528 8138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:55.545670 8138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:55.545869 8138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:43:55.556180 8138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:55.557627 8138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:55.559098 8138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:55.574540 8148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:55.574499 8147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:55.574591 8151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:55.575436 8138 server_base.cc:1034] running on GCE node
I20260808 08:43:55.576179 8138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:55.577306 8138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:55.578596 8138 hybrid_clock.cc:648] HybridClock initialized: now 1786178635578543 us; error 39 us; skew 500 ppm
I20260808 08:43:55.579018 8138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:55 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178635, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:55.582777 8138 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:43:55.584523 8138 webserver.cc:460] Webserver started at http://127.19.242.193:36075/ using document root <none> and password file <none>
I20260808 08:43:55.585352 8138 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:55.585518 8138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:55.585891 8138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:55.589263 8138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "29c3a9d7b85542fdb7e22285b294a61a"
format_stamp: "Formatted at 2026-08-08 08:43:55 on dist-test-slave-39l8"
server_key: "193e1e5d3c0292444e68c5bf458b0602"
server_key_iv: "1a2995bf0d5971a4f3080f71278c48c7"
server_key_version: "encryptionkey@0"
I20260808 08:43:55.590095 8138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "29c3a9d7b85542fdb7e22285b294a61a"
format_stamp: "Formatted at 2026-08-08 08:43:55 on dist-test-slave-39l8"
server_key: "193e1e5d3c0292444e68c5bf458b0602"
server_key_iv: "1a2995bf0d5971a4f3080f71278c48c7"
server_key_version: "encryptionkey@0"
I20260808 08:43:55.596187 8138 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 08:43:55.600567 8160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:55.602191 8138 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:43:55.602419 8138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "29c3a9d7b85542fdb7e22285b294a61a"
format_stamp: "Formatted at 2026-08-08 08:43:55 on dist-test-slave-39l8"
server_key: "193e1e5d3c0292444e68c5bf458b0602"
server_key_iv: "1a2995bf0d5971a4f3080f71278c48c7"
server_key_version: "encryptionkey@0"
I20260808 08:43:55.602666 8138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:55.619865 8138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:55.625272 8138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:55.625615 8138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:55.626680 8138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:55.628265 8138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:55.628345 8138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:55.628479 8138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:55.628546 8138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:55.663524 8138 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:35471
I20260808 08:43:55.663568 8331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:35471 every 8 connection(s)
I20260808 08:43:55.665175 8138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:43:55.668529 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 8138
I20260808 08:43:55.668787 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:43:55.669716 20427 external_mini_cluster.cc:1428] Setting key 331434771628b86e6442ef956fa12c28
Aug 08 08:43:55 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178635, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:55.688402 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:55.668245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:44689 (local address 127.19.242.254:36009)
0808 08:43:55.668795 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:55.668801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:55.670211 (+ 1410us) server_negotiation.cc:407] Connection header received
0808 08:43:55.672471 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:55.672476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:55.672573 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:55.672697 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:55.674333 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:55.675178 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:55.676886 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:55.677324 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:55.677477 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:55.681726 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:55.681734 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:55.681737 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:55.681777 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:55.684789 (+ 3012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:55.685681 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:55.685687 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:55.685692 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:55.685838 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:55.686425 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:55.686430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:55.686435 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:55.686797 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:55.686966 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:55.687750 (+ 784us) server_negotiation.cc:299] Negotiation successful
0808 08:43:55.688007 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":287,"threads_started":1}
I20260808 08:43:55.689548 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:55.669025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:44689)
0808 08:43:55.670016 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:55.670071 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:55.672155 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:55.672972 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:55.672982 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:55.673516 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:55.674142 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:55.674160 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:55.675384 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:55.675388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:55.676697 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:55.676712 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:55.677587 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:55.677596 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:55.677878 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:55.678679 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:55.678784 (+ 105us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:55.681425 (+ 2641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:55.684996 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:55.685008 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:55.685035 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:55.685527 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:55.685971 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:55.685977 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:55.685980 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:55.686300 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:55.686940 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:55.686949 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:55.687351 (+ 402us) client_negotiation.cc:769] Sending connection context
0808 08:43:55.687641 (+ 290us) client_negotiation.cc:240] Negotiation successful
0808 08:43:55.688256 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":378,"threads_started":1}
I20260808 08:43:55.691490 8333 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36009
I20260808 08:43:55.691910 8333 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:55.692948 8333 heartbeater.cc:511] Master 127.19.242.254:36009 requested a full tablet report, sending...
I20260808 08:43:55.695742 8052 ts_manager.cc:194] Registered new tserver with Master: 29c3a9d7b85542fdb7e22285b294a61a (127.19.242.193:35471)
I20260808 08:43:55.697376 8052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:44689
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:43:55.743410 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36009
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:56.108615 8340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:56.108951 8340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:56.109052 8340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:56.116854 8340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:56.117025 8340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:56.117226 8340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:43:56.127856 8340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:56.129354 8340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:56.130919 8340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:56.145932 8345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:56.145866 8346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:56.145900 8354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:56.146858 8340 server_base.cc:1034] running on GCE node
I20260808 08:43:56.147625 8340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:56.148787 8340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:56.150074 8340 hybrid_clock.cc:648] HybridClock initialized: now 1786178636150013 us; error 49 us; skew 500 ppm
I20260808 08:43:56.150468 8340 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:56 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178636, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:56.154107 8340 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:43:56.155948 8340 webserver.cc:460] Webserver started at http://127.19.242.194:45737/ using document root <none> and password file <none>
I20260808 08:43:56.156797 8340 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:56.156968 8340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:56.157320 8340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:56.160706 8340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "07b7c29b44034f1992880e9d13eba99d"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "4610d23df29a7737d5f99aa044a4267b"
server_key_iv: "076f0ab670cdbcd6882eb8c06d97cf85"
server_key_version: "encryptionkey@0"
I20260808 08:43:56.161695 8340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "07b7c29b44034f1992880e9d13eba99d"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "4610d23df29a7737d5f99aa044a4267b"
server_key_iv: "076f0ab670cdbcd6882eb8c06d97cf85"
server_key_version: "encryptionkey@0"
I20260808 08:43:56.168048 8340 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 08:43:56.173113 8366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:56.174885 8340 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:56.175128 8340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "07b7c29b44034f1992880e9d13eba99d"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "4610d23df29a7737d5f99aa044a4267b"
server_key_iv: "076f0ab670cdbcd6882eb8c06d97cf85"
server_key_version: "encryptionkey@0"
I20260808 08:43:56.175432 8340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:56.190943 8340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:56.195842 8340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:56.196195 8340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:56.197346 8340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:56.199213 8340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:56.199343 8340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:56.199505 8340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:56.199592 8340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:56.245400 8340 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45837
I20260808 08:43:56.245445 8525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45837 every 8 connection(s)
I20260808 08:43:56.246909 8340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:43:56.248466 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 8340
I20260808 08:43:56.248692 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:43:56.249210 20427 external_mini_cluster.cc:1428] Setting key 6c3af817d8b05d1dffd3b08a6e8e0c51
Aug 08 08:43:56 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178636, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:56.271698 8531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.249953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:39673 (local address 127.19.242.254:36009)
0808 08:43:56.250504 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:56.250512 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:56.251820 (+ 1308us) server_negotiation.cc:407] Connection header received
0808 08:43:56.253853 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:56.253862 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:56.253969 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:56.254107 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:56.256036 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.257212 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.259034 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.259799 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.259965 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.264310 (+ 4345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:56.264320 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:56.264325 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:56.264381 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:56.267505 (+ 3124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:56.268866 (+ 1361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:56.268871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:56.268874 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:56.269047 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:56.269658 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:56.269662 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:56.269665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:56.269957 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:56.270077 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:56.271191 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0808 08:43:56.271411 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":260,"threads_started":1}
I20260808 08:43:56.273476 8532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.250635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:39673)
0808 08:43:56.251629 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:56.251684 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:56.253513 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:56.254391 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:56.254400 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:56.255105 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:56.255809 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.255830 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.257415 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.257419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.258856 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.258872 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.260048 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.260053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.260282 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.261077 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:56.261104 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:56.263912 (+ 2808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:56.267760 (+ 3848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:56.267775 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:56.267800 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:56.268668 (+ 868us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:56.269185 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:56.269193 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:56.269199 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:56.269510 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:56.270110 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:56.270122 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:56.270669 (+ 547us) client_negotiation.cc:769] Sending connection context
0808 08:43:56.271081 (+ 412us) client_negotiation.cc:240] Negotiation successful
0808 08:43:56.271732 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":402,"threads_started":1}
I20260808 08:43:56.275533 8526 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36009
I20260808 08:43:56.275921 8526 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:56.276773 8526 heartbeater.cc:511] Master 127.19.242.254:36009 requested a full tablet report, sending...
I20260808 08:43:56.278543 8052 ts_manager.cc:194] Registered new tserver with Master: 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837)
I20260808 08:43:56.280000 8052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:39673
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:43:56.324898 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36009
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:43:56.701874 8333 heartbeater.cc:503] Master 127.19.242.254:36009 was elected leader, sending a full tablet report...
W20260808 08:43:56.701949 8538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:56.702432 8538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:56.702634 8538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:56.712179 8538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:56.712386 8538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:56.712589 8538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:43:56.724238 8538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:56.725751 8538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:56.727222 8538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:56.742416 8547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:56.742334 8550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:56.742374 8548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:56.743782 8538 server_base.cc:1034] running on GCE node
I20260808 08:43:56.744597 8538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:56.745673 8538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:56.746898 8538 hybrid_clock.cc:648] HybridClock initialized: now 1786178636746843 us; error 37 us; skew 500 ppm
I20260808 08:43:56.747294 8538 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:56 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178636, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:56.751331 8538 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:43:56.753329 8538 webserver.cc:460] Webserver started at http://127.19.242.195:40565/ using document root <none> and password file <none>
I20260808 08:43:56.754150 8538 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:56.754319 8538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:56.754683 8538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:43:56.758111 8538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "f814ac76000e46bbbcebf5a3b43385e8"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "7e550fb89cb433289de16c26b955d43c"
server_key_iv: "5eae4c1a8168446f9e52690dee4a0c00"
server_key_version: "encryptionkey@0"
I20260808 08:43:56.759142 8538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "f814ac76000e46bbbcebf5a3b43385e8"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "7e550fb89cb433289de16c26b955d43c"
server_key_iv: "5eae4c1a8168446f9e52690dee4a0c00"
server_key_version: "encryptionkey@0"
I20260808 08:43:56.766471 8538 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 08:43:56.770939 8559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:56.772635 8538 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:56.772852 8538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "f814ac76000e46bbbcebf5a3b43385e8"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "7e550fb89cb433289de16c26b955d43c"
server_key_iv: "5eae4c1a8168446f9e52690dee4a0c00"
server_key_version: "encryptionkey@0"
I20260808 08:43:56.773101 8538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:56.798465 8538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:56.803555 8538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:56.803890 8538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:56.805070 8538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:56.806881 8538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:56.807015 8538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:56.807185 8538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:56.807260 8538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:56.845098 8538 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:37277
I20260808 08:43:56.845172 8736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:37277 every 8 connection(s)
I20260808 08:43:56.846510 8538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:43:56.849500 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 8538
I20260808 08:43:56.849750 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:43:56.850435 20427 external_mini_cluster.cc:1428] Setting key 547f2592b69e1902b7cb460c937ffe16
Aug 08 08:43:56 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178636, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:56.871345 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.851071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:45351 (local address 127.19.242.254:36009)
0808 08:43:56.853048 (+ 1977us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:56.853057 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:56.853085 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:43:56.854418 (+ 1333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:56.854426 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:56.854531 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:56.854657 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:56.856468 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.857294 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.859165 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.859600 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.859776 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.863964 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:56.863971 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:56.863975 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:56.864020 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:56.867480 (+ 3460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:56.868665 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:56.868670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:56.868672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:56.868825 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:56.869348 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:56.869352 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:56.869354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:56.869667 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:56.869804 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:56.870677 (+ 873us) server_negotiation.cc:299] Negotiation successful
0808 08:43:56.870968 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1824,"thread_start_us":1669,"threads_started":1}
I20260808 08:43:56.872296 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.850550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:45351)
0808 08:43:56.851710 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:56.851768 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:56.854075 (+ 2307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:56.854991 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:56.855000 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:56.855576 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:56.856264 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.856286 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.857484 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.857488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.858968 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.858985 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.859888 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.859898 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.860187 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.860970 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:56.860996 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:56.863629 (+ 2633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:56.867860 (+ 4231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:56.867880 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:56.867897 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:56.868495 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:56.868950 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:56.868954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:56.868957 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:56.869189 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:56.869801 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:56.869808 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:56.870193 (+ 385us) client_negotiation.cc:769] Sending connection context
0808 08:43:56.870495 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 08:43:56.871044 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"thread_start_us":441,"threads_started":1}
I20260808 08:43:56.874212 8737 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36009
I20260808 08:43:56.874564 8737 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:56.875451 8737 heartbeater.cc:511] Master 127.19.242.254:36009 requested a full tablet report, sending...
I20260808 08:43:56.877234 8052 ts_manager.cc:194] Registered new tserver with Master: f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277)
I20260808 08:43:56.878422 8052 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:45351
I20260808 08:43:56.880424 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:43:56.900776 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.886137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40524 (local address 127.19.242.254:36009)
0808 08:43:56.886355 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:56.886361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:56.886893 (+ 532us) server_negotiation.cc:407] Connection header received
0808 08:43:56.887114 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:56.887120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:56.887224 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:56.887346 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:56.888908 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.889816 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.891362 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.891805 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.891962 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.894614 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:56.894619 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:56.894623 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:56.894666 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:56.897556 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:56.898422 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:56.898428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:56.898432 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:56.898585 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:56.899085 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:56.899091 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:56.899095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:56.899471 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:56.899768 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:56.900161 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 08:43:56.900429 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 08:43:56.905730 8052 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40524:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:43:56.913231 8052 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:43:56.951618 8759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.928076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52542)
0808 08:43:56.928977 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:56.929039 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:56.929307 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:56.942049 (+ 12742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:56.942085 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:56.942152 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:56.942843 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.942865 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.945293 (+ 2428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.945299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.948113 (+ 2814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.948129 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.950417 (+ 2288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.950428 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.950676 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.950787 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 08:43:56.950931 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 08:43:56.951167 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":373,"threads_started":1}
I20260808 08:43:56.951979 8766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.930327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45652 (local address 127.19.242.194:45837)
0808 08:43:56.941365 (+ 11038us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:56.941379 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:56.942386 (+ 1007us) server_negotiation.cc:407] Connection header received
0808 08:43:56.942511 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:56.942520 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:56.942856 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:56.943108 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:56.944064 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.945847 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.948695 (+ 2848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.950316 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.950502 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.950752 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:56.951373 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 08:43:56.951599 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10834,"thread_start_us":10692,"threads_started":1}
I20260808 08:43:56.952764 8765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.929641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45837 (local address 127.0.0.1:45652)
0808 08:43:56.941994 (+ 12353us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:56.942034 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:56.942210 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:56.943258 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:56.943263 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:56.943295 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:56.943805 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.943820 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.946054 (+ 2234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.946064 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.948470 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.948488 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.950922 (+ 2434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.950929 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.951127 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.951160 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:43:56.951266 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:43:56.951421 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12202,"mutex_wait_us":1,"thread_start_us":11997,"threads_started":1}
I20260808 08:43:56.952879 8760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.928420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52542 (local address 127.19.242.193:35471)
0808 08:43:56.940940 (+ 12520us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:56.940952 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:56.940989 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:43:56.941141 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:56.941155 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:56.941616 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:56.943197 (+ 1581us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:56.943615 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.945068 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.948328 (+ 3260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.950074 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.951859 (+ 1785us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.952218 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:56.952314 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 08:43:56.952533 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12285,"thread_start_us":12089,"threads_started":1}
I20260808 08:43:56.953487 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.928730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:37277 (local address 127.0.0.1:34176)
0808 08:43:56.939567 (+ 10837us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:56.939605 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:56.939857 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:56.944732 (+ 4875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:56.944738 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:56.944772 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:56.945232 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.945250 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.947630 (+ 2380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.947641 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.950316 (+ 2675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:56.950333 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.952544 (+ 2211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.952559 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:56.952794 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.952849 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 08:43:56.952941 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:43:56.953137 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10578,"thread_start_us":11288,"threads_started":1}
I20260808 08:43:56.954216 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:56.929379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34176 (local address 127.19.242.195:37277)
0808 08:43:56.943971 (+ 14592us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:56.943983 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:56.944040 (+ 57us) server_negotiation.cc:407] Connection header received
0808 08:43:56.944158 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:56.944169 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:56.944464 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:56.944702 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:56.945508 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.947425 (+ 1917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.950559 (+ 3134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:56.952238 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:56.953216 (+ 978us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:56.953420 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:56.953653 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 08:43:56.953866 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14362,"thread_start_us":14180,"threads_started":1}
I20260808 08:43:56.957343 8434 tablet_service.cc:1467] Processing CreateTablet for tablet 934724552dd64c4ebb01f994d9e37476 (DEFAULT_TABLE table=test-table [id=d728057032f9484e9c8d6cc3a558b973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:56.957381 8238 tablet_service.cc:1467] Processing CreateTablet for tablet 934724552dd64c4ebb01f994d9e37476 (DEFAULT_TABLE table=test-table [id=d728057032f9484e9c8d6cc3a558b973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:56.958900 8434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 934724552dd64c4ebb01f994d9e37476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:56.959038 8238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 934724552dd64c4ebb01f994d9e37476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:56.959365 8636 tablet_service.cc:1467] Processing CreateTablet for tablet 934724552dd64c4ebb01f994d9e37476 (DEFAULT_TABLE table=test-table [id=d728057032f9484e9c8d6cc3a558b973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:56.961010 8636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 934724552dd64c4ebb01f994d9e37476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:56.976795 8771 tablet_bootstrap.cc:492] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Bootstrap starting.
I20260808 08:43:56.981621 8769 tablet_bootstrap.cc:492] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Bootstrap starting.
I20260808 08:43:56.985387 8771 tablet_bootstrap.cc:654] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:56.987129 8771 log.cc:824] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:56.988950 8769 tablet_bootstrap.cc:654] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:56.990770 8769 log.cc:824] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:56.991179 8772 tablet_bootstrap.cc:492] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Bootstrap starting.
I20260808 08:43:56.993602 8771 tablet_bootstrap.cc:492] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: No bootstrap required, opened a new log
I20260808 08:43:56.993935 8771 ts_tablet_manager.cc:1397] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.000s
I20260808 08:43:56.994401 8769 tablet_bootstrap.cc:492] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: No bootstrap required, opened a new log
I20260808 08:43:56.994724 8769 ts_tablet_manager.cc:1397] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260808 08:43:56.996419 8772 tablet_bootstrap.cc:654] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Neither blocks nor log segments found. Creating new log.
I20260808 08:43:56.997875 8772 log.cc:824] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:57.002197 8772 tablet_bootstrap.cc:492] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: No bootstrap required, opened a new log
I20260808 08:43:57.002790 8772 ts_tablet_manager.cc:1397] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260808 08:43:57.003934 8769 raft_consensus.cc:348] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.004557 8769 raft_consensus.cc:374] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:57.004683 8769 raft_consensus.cc:729] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c3a9d7b85542fdb7e22285b294a61a, State: Initialized, Role: FOLLOWER
I20260808 08:43:57.004652 8771 raft_consensus.cc:348] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.005216 8771 raft_consensus.cc:374] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:57.005336 8771 raft_consensus.cc:729] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b7c29b44034f1992880e9d13eba99d, State: Initialized, Role: FOLLOWER
I20260808 08:43:57.005534 8769 consensus_queue.cc:260] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.005993 8771 consensus_queue.cc:260] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.007730 8769 ts_tablet_manager.cc:1428] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 08:43:57.008992 8526 heartbeater.cc:503] Master 127.19.242.254:36009 was elected leader, sending a full tablet report...
I20260808 08:43:57.009794 8771 ts_tablet_manager.cc:1428] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Time spent starting tablet: real 0.016s user 0.014s sys 0.002s
I20260808 08:43:57.017017 8772 raft_consensus.cc:348] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.017544 8772 raft_consensus.cc:374] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:43:57.017639 8772 raft_consensus.cc:729] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f814ac76000e46bbbcebf5a3b43385e8, State: Initialized, Role: FOLLOWER
I20260808 08:43:57.018242 8772 consensus_queue.cc:260] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.019569 8737 heartbeater.cc:503] Master 127.19.242.254:36009 was elected leader, sending a full tablet report...
I20260808 08:43:57.020098 8772 ts_tablet_manager.cc:1428] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Time spent starting tablet: real 0.017s user 0.009s sys 0.006s
I20260808 08:43:57.061896 8779 raft_consensus.cc:482] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:43:57.062251 8779 raft_consensus.cc:504] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.064247 8779 leader_election.cc:288] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837), f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277)
I20260808 08:43:57.071966 8766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.064594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:48359 (local address 127.19.242.194:45837)
0808 08:43:57.064856 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:57.064862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:57.065671 (+ 809us) server_negotiation.cc:407] Connection header received
0808 08:43:57.065874 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:57.065882 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:57.065971 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:57.066072 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:57.066792 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.067644 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.069994 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.070882 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.071097 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.071177 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:57.071526 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 08:43:57.071672 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 08:43:57.071960 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.065023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:40959 (local address 127.19.242.195:37277)
0808 08:43:57.065242 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:57.065247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:57.065922 (+ 675us) server_negotiation.cc:407] Connection header received
0808 08:43:57.066107 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:57.066112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:57.066193 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:57.066374 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:57.067044 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.067842 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.069947 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.070861 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.071049 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.071152 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:57.071527 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 08:43:57.071667 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:43:57.072213 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.064434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45837 (local address 127.19.242.193:48359)
0808 08:43:57.065507 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:57.065533 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:57.065712 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:57.066113 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:57.066118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:57.066144 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:57.066614 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:57.066625 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.067815 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.067820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:57.069774 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:57.069789 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.071171 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.071179 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:57.071328 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.071373 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 08:43:57.071491 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:43:57.071660 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":891,"mutex_wait_us":78,"thread_start_us":609,"threads_started":1}
I20260808 08:43:57.072477 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.064812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:37277 (local address 127.19.242.193:40959)
0808 08:43:57.065795 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:57.065814 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:57.065948 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:57.066418 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:57.066421 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:57.066445 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:57.066874 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:57.066887 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.068001 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.068005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:57.069749 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:57.069769 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.071137 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.071148 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:57.071325 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.071377 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 08:43:57.071492 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:43:57.071660 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"mutex_wait_us":26,"thread_start_us":584,"threads_started":1}
I20260808 08:43:57.073608 8460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934724552dd64c4ebb01f994d9e37476" candidate_uuid: "29c3a9d7b85542fdb7e22285b294a61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b7c29b44034f1992880e9d13eba99d" is_pre_election: true
I20260808 08:43:57.073608 8664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934724552dd64c4ebb01f994d9e37476" candidate_uuid: "29c3a9d7b85542fdb7e22285b294a61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f814ac76000e46bbbcebf5a3b43385e8" is_pre_election: true
I20260808 08:43:57.074257 8664 raft_consensus.cc:2454] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29c3a9d7b85542fdb7e22285b294a61a in term 0.
I20260808 08:43:57.074257 8460 raft_consensus.cc:2454] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29c3a9d7b85542fdb7e22285b294a61a in term 0.
I20260808 08:43:57.075148 8163 leader_election.cc:302] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 07b7c29b44034f1992880e9d13eba99d, 29c3a9d7b85542fdb7e22285b294a61a, f814ac76000e46bbbcebf5a3b43385e8; no voters:
I20260808 08:43:57.075644 8779 raft_consensus.cc:2781] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:43:57.075819 8779 raft_consensus.cc:482] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:43:57.075937 8779 raft_consensus.cc:3037] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:57.078821 8779 raft_consensus.cc:504] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.079656 8779 leader_election.cc:288] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 1 election: Requested vote from peers 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837), f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277)
I20260808 08:43:57.080269 8460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934724552dd64c4ebb01f994d9e37476" candidate_uuid: "29c3a9d7b85542fdb7e22285b294a61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b7c29b44034f1992880e9d13eba99d"
I20260808 08:43:57.080312 8664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934724552dd64c4ebb01f994d9e37476" candidate_uuid: "29c3a9d7b85542fdb7e22285b294a61a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f814ac76000e46bbbcebf5a3b43385e8"
I20260808 08:43:57.080559 8460 raft_consensus.cc:3037] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:57.080555 8664 raft_consensus.cc:3037] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:43:57.083366 8664 raft_consensus.cc:2454] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29c3a9d7b85542fdb7e22285b294a61a in term 1.
I20260808 08:43:57.083647 8460 raft_consensus.cc:2454] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29c3a9d7b85542fdb7e22285b294a61a in term 1.
I20260808 08:43:57.083979 8167 leader_election.cc:302] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29c3a9d7b85542fdb7e22285b294a61a, f814ac76000e46bbbcebf5a3b43385e8; no voters:
I20260808 08:43:57.084350 8779 raft_consensus.cc:2781] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:43:57.084908 8779 raft_consensus.cc:686] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 LEADER]: Becoming Leader. State: Replica: 29c3a9d7b85542fdb7e22285b294a61a, State: Running, Role: LEADER
I20260808 08:43:57.085542 8779 consensus_queue.cc:237] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } }
I20260808 08:43:57.090919 8051 catalog_manager.cc:5495] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a reported cstate change: term changed from 0 to 1, leader changed from <none> to 29c3a9d7b85542fdb7e22285b294a61a (127.19.242.193). New cstate: current_term: 1 leader_uuid: "29c3a9d7b85542fdb7e22285b294a61a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } health_report { overall_health: UNKNOWN } } }
W20260808 08:43:57.098459 8739 tablet.cc:2369] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:43:57.124130 8760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.117884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.19.242.193:35471)
0808 08:43:57.118126 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:57.118132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:57.118309 (+ 177us) server_negotiation.cc:407] Connection header received
0808 08:43:57.118596 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:57.118600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:57.118796 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:57.118978 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:43:57.119404 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.120204 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.121735 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.122176 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.122323 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.122926 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:43:57.123474 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:43:57.123655 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:57.123754 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 08:43:57.123845 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:43:57.133890 8664 raft_consensus.cc:1261] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 FOLLOWER]: Refusing update from remote peer 29c3a9d7b85542fdb7e22285b294a61a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:43:57.133898 8460 raft_consensus.cc:1261] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Refusing update from remote peer 29c3a9d7b85542fdb7e22285b294a61a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:43:57.135208 8779 consensus_queue.cc:1035] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:43:57.135588 8785 consensus_queue.cc:1035] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [LEADER]: Connected to new peer: Peer: permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:43:57.149326 8789 mvcc.cc:205] Tried to move back new op lower bound from 7316187697687556096 to 7316187697506971648. Current Snapshot: MvccSnapshot[applied={T|T < 7316187697687556096}]
I20260808 08:43:57.154225 8790 mvcc.cc:205] Tried to move back new op lower bound from 7316187697687556096 to 7316187697506971648. Current Snapshot: MvccSnapshot[applied={T|T < 7316187697687556096}]
I20260808 08:43:57.168552 8051 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:43:57.168895 8051 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:43:57.173341 8051 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Sending DeleteTablet for 3 replicas of tablet 934724552dd64c4ebb01f994d9e37476
I20260808 08:43:57.174924 8636 tablet_service.cc:1514] Processing DeleteTablet for tablet 934724552dd64c4ebb01f994d9e37476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:43:57 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:34176
I20260808 08:43:57.175073 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 8138
I20260808 08:43:57.175397 8238 tablet_service.cc:1514] Processing DeleteTablet for tablet 934724552dd64c4ebb01f994d9e37476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:43:57 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:52542
I20260808 08:43:57.175815 8434 tablet_service.cc:1514] Processing DeleteTablet for tablet 934724552dd64c4ebb01f994d9e37476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:43:57 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:45652
I20260808 08:43:57.188478 8801 tablet_replica.cc:330] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: stopping tablet replica
I20260808 08:43:57.192868 8803 tablet_replica.cc:330] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: stopping tablet replica
I20260808 08:43:57.193363 8801 raft_consensus.cc:2229] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:43:57.193550 8803 raft_consensus.cc:2229] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:43:57.194211 8803 raft_consensus.cc:2258] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:43:57.194262 8801 raft_consensus.cc:2258] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:43:57.197139 8803 ts_tablet_manager.cc:1905] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:43:57.204113 8801 ts_tablet_manager.cc:1905] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:43:57.205101 8802 tablet_replica.cc:330] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: stopping tablet replica
I20260808 08:43:57.205773 8803 ts_tablet_manager.cc:1918] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:43:57.205835 8802 raft_consensus.cc:2229] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:43:57.206049 8803 log.cc:1196] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/934724552dd64c4ebb01f994d9e37476
I20260808 08:43:57.206790 8803 ts_tablet_manager.cc:1939] T 934724552dd64c4ebb01f994d9e37476 P 07b7c29b44034f1992880e9d13eba99d: Deleting consensus metadata
I20260808 08:43:57.206765 8802 raft_consensus.cc:2258] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:43:57.209259 8030 catalog_manager.cc:4841] TS 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837): tablet 934724552dd64c4ebb01f994d9e37476 (table test-table [id=d728057032f9484e9c8d6cc3a558b973]) successfully deleted
I20260808 08:43:57.211995 8802 ts_tablet_manager.cc:1905] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:43:57 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:43:57.213302 8801 ts_tablet_manager.cc:1918] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:43:57.213536 8801 log.cc:1196] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/934724552dd64c4ebb01f994d9e37476
I20260808 08:43:57.214171 8801 ts_tablet_manager.cc:1939] T 934724552dd64c4ebb01f994d9e37476 P f814ac76000e46bbbcebf5a3b43385e8: Deleting consensus metadata
I20260808 08:43:57.216411 8036 catalog_manager.cc:4841] TS f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277): tablet 934724552dd64c4ebb01f994d9e37476 (table test-table [id=d728057032f9484e9c8d6cc3a558b973]) successfully deleted
I20260808 08:43:57.221424 8802 ts_tablet_manager.cc:1918] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:43:57.221658 8802 log.cc:1196] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/934724552dd64c4ebb01f994d9e37476
I20260808 08:43:57.222343 8802 ts_tablet_manager.cc:1939] T 934724552dd64c4ebb01f994d9e37476 P 29c3a9d7b85542fdb7e22285b294a61a: Deleting consensus metadata
I20260808 08:43:57.224117 8760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.176735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52564 (local address 127.19.242.193:35471)
0808 08:43:57.177019 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:57.177030 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:57.187352 (+ 10322us) server_negotiation.cc:407] Connection header received
0808 08:43:57.188933 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:57.188947 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:57.189104 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:57.189242 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:57.194946 (+ 5704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.196845 (+ 1899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.206961 (+ 10116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.207753 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.207920 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.214752 (+ 6832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:57.214775 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:57.214794 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:57.214850 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:57.219744 (+ 4894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:57.220818 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:57.220829 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:57.220832 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:57.221059 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:57.221625 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:57.221633 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:57.221637 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:57.222231 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:57.222562 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:57.223268 (+ 706us) server_negotiation.cc:299] Negotiation successful
0808 08:43:57.223541 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 08:43:57.224355 8030 catalog_manager.cc:4841] TS 29c3a9d7b85542fdb7e22285b294a61a (127.19.242.193:35471): tablet 934724552dd64c4ebb01f994d9e37476 (table test-table [id=d728057032f9484e9c8d6cc3a558b973]) successfully deleted
I20260808 08:43:57.225103 8325 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:57.332589 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 8138
I20260808 08:43:57.364245 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 8340
Aug 08 08:43:57 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:43:57.381699 8766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.365119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45662 (local address 127.19.242.194:45837)
0808 08:43:57.365311 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:57.365316 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:57.365337 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:43:57.365420 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:57.365424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:57.365490 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:57.365588 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:57.367005 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.367848 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.369250 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.369652 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.369776 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.374620 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:57.374640 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:57.374659 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:57.374931 (+ 272us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:57.378189 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:57.379260 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:57.379271 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:57.379275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:57.379469 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:57.379954 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:57.379957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:57.379960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:57.380487 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:57.380757 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:57.381155 (+ 398us) server_negotiation.cc:299] Negotiation successful
0808 08:43:57.381375 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:43:57.382630 8520 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:57.478449 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 8340
I20260808 08:43:57.501451 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 8538
Aug 08 08:43:57 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:43:57.518237 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:57.502329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34180 (local address 127.19.242.195:37277)
0808 08:43:57.502509 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:57.502514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:57.502534 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:43:57.502597 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:57.502601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:57.502684 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:57.502839 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:57.504317 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.505165 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.506510 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:57.506986 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:57.507095 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:57.511899 (+ 4804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:57.511918 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:57.511935 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:57.511977 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:57.515208 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:57.516149 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:57.516157 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:57.516160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:57.516316 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:57.516749 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:57.516754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:57.516758 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:57.517212 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:57.517454 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:57.517785 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 08:43:57.517977 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:43:57.519034 8730 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:57.610474 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 8538
I20260808 08:43:57.639546 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 8008
I20260808 08:43:57.640798 8096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:43:57.756114 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 8008
I20260808 08:43:57.788450 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36009
--webserver_interface=127.19.242.254
--webserver_port=35061
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:43:58.167207 8812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:58.167560 8812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:58.167737 8812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:58.177819 8812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:43:58.178040 8812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:58.178153 8812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:58.178254 8812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:43:58.178345 8812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:43:58.189606 8812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=35061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:58.191233 8812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:58.192747 8812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:58.223369 8829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:58.223413 8822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:58.223460 8826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:58.225220 8812 server_base.cc:1034] running on GCE node
I20260808 08:43:58.226310 8812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:58.228377 8812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:58.229657 8812 hybrid_clock.cc:648] HybridClock initialized: now 1786178638229588 us; error 60 us; skew 500 ppm
I20260808 08:43:58.230188 8812 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:58 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178638, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:58.238382 8812 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:43:58.240592 8812 webserver.cc:460] Webserver started at http://127.19.242.254:35061/ using document root <none> and password file <none>
I20260808 08:43:58.241600 8812 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:58.241818 8812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:58.249366 8812 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:43:58.253449 8838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:58.255577 8812 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:43:58.255861 8812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "7083e294617e45778ebca11786df8955"
format_stamp: "Formatted at 2026-08-08 08:43:54 on dist-test-slave-39l8"
server_key: "f3d2d12d2d8819bc85cc53a4c0234227"
server_key_iv: "5ef8ffd69a16b5bc15cc91c5c05d43ec"
server_key_version: "encryptionkey@0"
I20260808 08:43:58.257232 8812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:58.274461 8812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:58.280031 8812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:58.280375 8812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:58.303474 8812 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36009
I20260808 08:43:58.303509 8916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36009 every 8 connection(s)
I20260808 08:43:58.305307 8812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:43:58.313117 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 8812
I20260808 08:43:58.313762 8917 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:43:58.314241 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:35471
--local_ip_for_outbound_sockets=127.19.242.193
--tserver_master_addrs=127.19.242.254:36009
--webserver_port=36075
--webserver_interface=127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:43:58.319787 8917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Bootstrap starting.
I20260808 08:43:58.342893 8917 log.cc:824] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Log is configured to *not* fsync() on all Append() calls
I20260808 08:43:58.359238 8917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:43:58.359923 8917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Bootstrap complete.
I20260808 08:43:58.371701 8917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:58.372833 8917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7083e294617e45778ebca11786df8955, State: Initialized, Role: FOLLOWER
I20260808 08:43:58.373596 8917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:58.373900 8917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:43:58.374050 8917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:43:58.374285 8917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:43:58.379045 8917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:58.379827 8917 leader_election.cc:302] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7083e294617e45778ebca11786df8955; no voters:
I20260808 08:43:58.380586 8917 leader_election.cc:288] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:43:58.380760 8925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:43:58.382231 8925 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 LEADER]: Becoming Leader. State: Replica: 7083e294617e45778ebca11786df8955, State: Running, Role: LEADER
I20260808 08:43:58.383049 8925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:43:58.383534 8917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:43:58.386303 8928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7083e294617e45778ebca11786df8955. Latest consensus state: current_term: 2 leader_uuid: "7083e294617e45778ebca11786df8955" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } } }
I20260808 08:43:58.386379 8927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7083e294617e45778ebca11786df8955" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } } }
I20260808 08:43:58.386870 8927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:58.386744 8928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: This master's current role is: LEADER
I20260808 08:43:58.387948 8939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:43:58.403504 8939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:43:58.406013 8939 catalog_manager.cc:1259] Loaded cluster ID: 274ce40dcb3e4ef29f7af7f391b2ff5d
I20260808 08:43:58.406283 8939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:43:58.411784 8939 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 08:43:58.441856 8939 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 08:43:58.464746 8939 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:43:58.466811 8939 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Loaded TSK: 0
I20260808 08:43:58.468549 8939 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:43:58.718456 8922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:58.718932 8922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:58.719120 8922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:58.726765 8922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:58.726945 8922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:58.727137 8922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:43:58.737457 8922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:35471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=36075
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:58.738993 8922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:58.740455 8922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:58.757405 8959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:58.757414 8960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:58.758669 8962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:58.758759 8922 server_base.cc:1034] running on GCE node
I20260808 08:43:58.759548 8922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:58.760756 8922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:58.762004 8922 hybrid_clock.cc:648] HybridClock initialized: now 1786178638761967 us; error 41 us; skew 500 ppm
I20260808 08:43:58.762398 8922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:58 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178638, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:58.766341 8922 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:43:58.768201 8922 webserver.cc:460] Webserver started at http://127.19.242.193:36075/ using document root <none> and password file <none>
I20260808 08:43:58.769327 8922 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:58.769526 8922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:58.777140 8922 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:43:58.780771 8974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:58.782598 8922 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:43:58.782883 8922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "29c3a9d7b85542fdb7e22285b294a61a"
format_stamp: "Formatted at 2026-08-08 08:43:55 on dist-test-slave-39l8"
server_key: "193e1e5d3c0292444e68c5bf458b0602"
server_key_iv: "1a2995bf0d5971a4f3080f71278c48c7"
server_key_version: "encryptionkey@0"
I20260808 08:43:58.784219 8922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:58.809356 8922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:58.814440 8922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:58.814827 8922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:58.816039 8922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:58.817574 8922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:58.817711 8922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:58.817840 8922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:58.817930 8922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:58.856932 8922 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:35471
I20260808 08:43:58.857048 9172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:35471 every 8 connection(s)
I20260808 08:43:58.858530 8922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:43:58.860800 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 8922
I20260808 08:43:58.861624 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:45837
--local_ip_for_outbound_sockets=127.19.242.194
--tserver_master_addrs=127.19.242.254:36009
--webserver_port=45737
--webserver_interface=127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:43:58 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178638, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:58.891496 9176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:58.862433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:51583)
0808 08:43:58.863481 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:58.863547 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:58.866534 (+ 2987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:58.868239 (+ 1705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:58.868253 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:58.869130 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:58.869970 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:58.869999 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:58.871917 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:58.871926 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:58.874186 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:58.874208 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:58.875973 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:58.875980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:58.876221 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:58.877172 (+ 951us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:58.877201 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:58.879861 (+ 2660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:58.885767 (+ 5906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:58.885777 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:58.885792 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:58.886351 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:58.887073 (+ 722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:58.887077 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:58.887079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:58.887318 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:58.888370 (+ 1052us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:58.888380 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:58.888803 (+ 423us) client_negotiation.cc:769] Sending connection context
0808 08:43:58.889210 (+ 407us) client_negotiation.cc:240] Negotiation successful
0808 08:43:58.889898 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":405,"threads_started":1}
I20260808 08:43:58.891496 9175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:58.862044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:51583 (local address 127.19.242.254:36009)
0808 08:43:58.862800 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:58.862820 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:58.863720 (+ 900us) server_negotiation.cc:407] Connection header received
0808 08:43:58.867219 (+ 3499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:58.867233 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:58.867621 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:58.867956 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:58.870306 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:58.871705 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:58.874393 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:58.875655 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:58.875905 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:58.880286 (+ 4381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:58.880302 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:58.880329 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:58.880392 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:58.885498 (+ 5106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:58.886547 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:58.886561 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:58.886573 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:58.886910 (+ 337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:58.887466 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:58.887472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:58.887478 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:58.888178 (+ 700us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:58.888420 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:58.889465 (+ 1045us) server_negotiation.cc:299] Negotiation successful
0808 08:43:58.889918 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":310,"threads_started":1}
I20260808 08:43:58.895222 9173 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36009
I20260808 08:43:58.895601 9173 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:58.896446 9173 heartbeater.cc:511] Master 127.19.242.254:36009 requested a full tablet report, sending...
I20260808 08:43:58.899147 8865 ts_manager.cc:194] Registered new tserver with Master: 29c3a9d7b85542fdb7e22285b294a61a (127.19.242.193:35471)
I20260808 08:43:58.901280 8865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:51583
W20260808 08:43:59.238283 9177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:59.238618 9177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:59.238782 9177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:59.246243 9177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:59.246387 9177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:59.246505 9177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:43:59.257210 9177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:45837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=45737
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:59.258744 9177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:59.260149 9177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:59.275849 9187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:59.275691 9188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:59.275736 9190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:59.276777 9177 server_base.cc:1034] running on GCE node
I20260808 08:43:59.277518 9177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:59.278630 9177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:59.279891 9177 hybrid_clock.cc:648] HybridClock initialized: now 1786178639279820 us; error 66 us; skew 500 ppm
I20260808 08:43:59.280253 9177 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:59 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178639, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:59.283841 9177 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:43:59.285708 9177 webserver.cc:460] Webserver started at http://127.19.242.194:45737/ using document root <none> and password file <none>
I20260808 08:43:59.286479 9177 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:59.286664 9177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:59.293232 9177 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 08:43:59.296645 9205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:59.298357 9177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:43:59.298580 9177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "07b7c29b44034f1992880e9d13eba99d"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "4610d23df29a7737d5f99aa044a4267b"
server_key_iv: "076f0ab670cdbcd6882eb8c06d97cf85"
server_key_version: "encryptionkey@0"
I20260808 08:43:59.299767 9177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:59.313545 9177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:59.318416 9177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:59.318811 9177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:59.320091 9177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:59.321678 9177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:59.321815 9177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:59.321965 9177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:59.322064 9177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:59.359578 9177 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45837
I20260808 08:43:59.359712 9368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45837 every 8 connection(s)
I20260808 08:43:59.361274 9177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:43:59.370419 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 9177
I20260808 08:43:59.371220 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:37277
--local_ip_for_outbound_sockets=127.19.242.195
--tserver_master_addrs=127.19.242.254:36009
--webserver_port=40565
--webserver_interface=127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:43:59 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178639, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:59.389925 9175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.364364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:57309 (local address 127.19.242.254:36009)
0808 08:43:59.364591 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:59.364596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:59.365835 (+ 1239us) server_negotiation.cc:407] Connection header received
0808 08:43:59.367978 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:59.367982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:59.368093 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:59.368210 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:59.370109 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.371059 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.374210 (+ 3151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.374685 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.374888 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.380596 (+ 5708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:59.380602 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:59.380606 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:59.380652 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:59.385047 (+ 4395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:59.386379 (+ 1332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:59.386389 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:59.386396 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:59.386597 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:59.387186 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:59.387194 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:59.387202 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:59.387696 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:59.387873 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:59.388930 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0808 08:43:59.389371 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 08:43:59.390684 9373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.364836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:57309)
0808 08:43:59.365630 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:59.365673 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:59.367636 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:59.368453 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:59.368462 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:59.369174 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:59.369836 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.369904 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.371277 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.371284 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.373945 (+ 2661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.373971 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.375052 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.375064 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.375476 (+ 412us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.376437 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:59.376478 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:59.380223 (+ 3745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:59.385287 (+ 5064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:59.385303 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:59.385329 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:59.386177 (+ 848us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:59.386803 (+ 626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:59.386807 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:59.386809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:59.387040 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:59.387881 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:59.387889 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:59.388401 (+ 512us) client_negotiation.cc:769] Sending connection context
0808 08:43:59.388742 (+ 341us) client_negotiation.cc:240] Negotiation successful
0808 08:43:59.389287 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":319,"threads_started":1}
I20260808 08:43:59.392768 9369 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36009
I20260808 08:43:59.393150 9369 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:59.394053 9369 heartbeater.cc:511] Master 127.19.242.254:36009 requested a full tablet report, sending...
I20260808 08:43:59.396158 8865 ts_manager.cc:194] Registered new tserver with Master: 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837)
I20260808 08:43:59.397126 8865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:57309
W20260808 08:43:59.763281 9374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:43:59.763604 9374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:43:59.763770 9374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:43:59.771734 9374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:43:59.771872 9374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:43:59.772086 9374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:43:59.784040 9374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:37277
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=40565
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:43:59.785573 9374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:43:59.787128 9374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:43:59.802136 9381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:59.802209 9384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:43:59.802170 9382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:43:59.803982 9374 server_base.cc:1034] running on GCE node
I20260808 08:43:59.804881 9374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:43:59.806080 9374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:43:59.807370 9374 hybrid_clock.cc:648] HybridClock initialized: now 1786178639807328 us; error 111 us; skew 500 ppm
I20260808 08:43:59.807736 9374 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:43:59 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178639, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:43:59.811280 9374 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:43:59.813031 9374 webserver.cc:460] Webserver started at http://127.19.242.195:40565/ using document root <none> and password file <none>
I20260808 08:43:59.813840 9374 fs_manager.cc:359] Metadata directory not provided
I20260808 08:43:59.814026 9374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:43:59.820006 9374 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:43:59.823129 9391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:59.824695 9374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:43:59.824920 9374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "f814ac76000e46bbbcebf5a3b43385e8"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "7e550fb89cb433289de16c26b955d43c"
server_key_iv: "5eae4c1a8168446f9e52690dee4a0c00"
server_key_version: "encryptionkey@0"
I20260808 08:43:59.826025 9374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:43:59.852344 9374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:43:59.857300 9374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:43:59.857618 9374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:43:59.858827 9374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:43:59.860318 9374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:43:59.860445 9374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:59.860594 9374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:43:59.860695 9374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:43:59.898459 9374 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:37277
I20260808 08:43:59.898557 9550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:37277 every 8 connection(s)
I20260808 08:43:59.900115 9374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:43:59.901710 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 9374
I20260808 08:43:59.905099 9173 heartbeater.cc:503] Master 127.19.242.254:36009 was elected leader, sending a full tablet report...
Aug 08 08:43:59 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178639, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:43:59.921710 9556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.902890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40532 (local address 127.19.242.254:36009)
0808 08:43:59.903463 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:59.903469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:59.904142 (+ 673us) server_negotiation.cc:407] Connection header received
0808 08:43:59.904370 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:59.904380 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:59.904584 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:59.905797 (+ 1213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:59.907851 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.909163 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.910624 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.911354 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.911503 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.914592 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:59.914599 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:59.914606 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:59.914670 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:59.918055 (+ 3385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:59.919135 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:59.919140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:59.919143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:59.919295 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:59.919750 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:59.919756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:59.919759 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:59.920198 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:59.920486 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:59.920907 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 08:43:59.921176 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":728,"threads_started":1}
I20260808 08:43:59.926990 9558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.903464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:41607 (local address 127.19.242.254:36009)
0808 08:43:59.907190 (+ 3726us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:59.907197 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:59.907221 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:43:59.909541 (+ 2320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:59.909546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:59.909637 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:59.909791 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:43:59.912097 (+ 2306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.912870 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.914577 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.915163 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.915323 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.919474 (+ 4151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:43:59.919487 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:43:59.919491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:43:59.919522 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:43:59.923337 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:59.924296 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:59.924302 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:59.924305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:59.924478 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:43:59.924994 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:43:59.925000 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:43:59.925003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:43:59.925308 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:43:59.925476 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:59.926242 (+ 766us) server_negotiation.cc:299] Negotiation successful
0808 08:43:59.926490 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3591,"thread_start_us":3431,"threads_started":1}
I20260808 08:43:59.928079 9559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.903976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:41607)
0808 08:43:59.905079 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:59.905140 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:59.909183 (+ 4043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:59.910123 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:59.910134 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:59.910928 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:43:59.911878 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.911901 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.913098 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.913111 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.914406 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.914419 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.915429 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.915439 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.915704 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.916434 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:43:59.916460 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:43:59.919200 (+ 2740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:43:59.923544 (+ 4344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:59.923554 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:59.923576 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:59.924110 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:59.924616 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:43:59.924621 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:43:59.924624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:43:59.924856 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:43:59.925454 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:43:59.925463 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:43:59.925851 (+ 388us) client_negotiation.cc:769] Sending connection context
0808 08:43:59.926138 (+ 287us) client_negotiation.cc:240] Negotiation successful
0808 08:43:59.926792 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":433,"threads_started":1}
I20260808 08:43:59.929795 9554 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36009
I20260808 08:43:59.930148 9554 heartbeater.cc:464] Registering TS with master...
I20260808 08:43:59.931057 9554 heartbeater.cc:511] Master 127.19.242.254:36009 requested a full tablet report, sending...
I20260808 08:43:59.933094 8865 ts_manager.cc:194] Registered new tserver with Master: f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277)
I20260808 08:43:59.933984 8865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:41607
I20260808 08:43:59.937793 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:43:59.945634 9558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.938858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40534 (local address 127.19.242.254:36009)
0808 08:43:59.939035 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:59.939040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:59.939807 (+ 767us) server_negotiation.cc:407] Connection header received
0808 08:43:59.939933 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:59.939937 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:59.940095 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:59.940248 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:43:59.940741 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.941569 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.943290 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.943806 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.943929 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.944491 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:43:59.945037 (+ 546us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:43:59.945160 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:59.945336 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 08:43:59.945414 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:43:59.946882 8865 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:43:59.954559 8865 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:43:59.981343 9571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.969317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45668 (local address 127.19.242.194:45837)
0808 08:43:59.970936 (+ 1619us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:59.970949 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:59.971815 (+ 866us) server_negotiation.cc:407] Connection header received
0808 08:43:59.971928 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:59.971936 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:59.972186 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:59.972393 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:59.973320 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.974949 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.977961 (+ 3012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.979612 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.979770 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.979980 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:59.980778 (+ 798us) server_negotiation.cc:299] Negotiation successful
0808 08:43:59.980984 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1348,"thread_start_us":1198,"threads_started":1}
I20260808 08:43:59.982497 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.968266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45837 (local address 127.0.0.1:45668)
0808 08:43:59.971476 (+ 3210us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:59.971504 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:59.971637 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:59.972653 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:59.972659 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:59.972696 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:59.973108 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.973121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.975169 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.975174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.977755 (+ 2581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.977773 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.980203 (+ 2430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.980210 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.980433 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.980507 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 08:43:59.981796 (+ 1289us) client_negotiation.cc:240] Negotiation successful
0808 08:43:59.982041 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3082,"thread_start_us":2914,"threads_started":1}
I20260808 08:43:59.983314 9567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.968239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:37277 (local address 127.0.0.1:34188)
0808 08:43:59.969814 (+ 1575us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:59.969869 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:59.970112 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:59.972073 (+ 1961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:59.972081 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:59.972111 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:59.972623 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.972637 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.976465 (+ 3828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.976477 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.978621 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.978640 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.982363 (+ 3723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.982370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.982583 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.982633 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 08:43:59.982746 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:43:59.982880 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1211,"thread_start_us":1024,"threads_started":1}
I20260808 08:43:59.984544 9569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.968463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34188 (local address 127.19.242.195:37277)
0808 08:43:59.971367 (+ 2904us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:59.971373 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:59.971402 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:43:59.971490 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:59.971496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:59.971785 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:59.974275 (+ 2490us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:59.974582 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.976271 (+ 1689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.980416 (+ 4145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.982059 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.983362 (+ 1303us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.983608 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:59.983700 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 08:43:59.984182 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2757,"thread_start_us":2564,"threads_started":1}
I20260808 08:43:59.989624 9458 tablet_service.cc:1467] Processing CreateTablet for tablet de5a21e568d44b6ba92decaca3f0fa85 (DEFAULT_TABLE table=test-table [id=ab8042cbe70e4781b5ac9373e8d51a7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:59.989627 9267 tablet_service.cc:1467] Processing CreateTablet for tablet de5a21e568d44b6ba92decaca3f0fa85 (DEFAULT_TABLE table=test-table [id=ab8042cbe70e4781b5ac9373e8d51a7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:59.991297 9458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5a21e568d44b6ba92decaca3f0fa85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:59.991285 9267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5a21e568d44b6ba92decaca3f0fa85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:43:59.991882 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.971678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52568)
0808 08:43:59.982883 (+ 11205us) negotiation.cc:107] Waiting for socket to connect
0808 08:43:59.982903 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:43:59.983021 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:43:59.985932 (+ 2911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:43:59.985937 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:43:59.985966 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:43:59.986210 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.986223 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.987844 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.987852 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.989336 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:43:59.989354 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.991027 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.991034 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:43:59.991210 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.991246 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:43:59.991369 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 08:43:59.991534 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11102,"thread_start_us":13983,"threads_started":1}
I20260808 08:43:59.992730 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:43:59.972033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.19.242.193:35471)
0808 08:43:59.984717 (+ 12684us) server_negotiation.cc:206] Beginning negotiation
0808 08:43:59.984731 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:43:59.985135 (+ 404us) server_negotiation.cc:407] Connection header received
0808 08:43:59.985282 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:43:59.985295 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:43:59.985655 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:43:59.985900 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:43:59.986404 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.987649 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.989553 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:43:59.990804 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:43:59.991043 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:43:59.991229 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:43:59.992314 (+ 1085us) server_negotiation.cc:299] Negotiation successful
0808 08:43:59.992497 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12416,"thread_start_us":12817,"threads_started":1}
I20260808 08:43:59.996642 9062 tablet_service.cc:1467] Processing CreateTablet for tablet de5a21e568d44b6ba92decaca3f0fa85 (DEFAULT_TABLE table=test-table [id=ab8042cbe70e4781b5ac9373e8d51a7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:43:59.998888 9062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de5a21e568d44b6ba92decaca3f0fa85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:00.009279 9577 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Bootstrap starting.
I20260808 08:44:00.010190 9576 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Bootstrap starting.
I20260808 08:44:00.015287 9577 tablet_bootstrap.cc:654] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:00.016398 9576 tablet_bootstrap.cc:654] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:00.016937 9577 log.cc:824] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:00.018292 9576 log.cc:824] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:00.019524 9579 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Bootstrap starting.
I20260808 08:44:00.024116 9577 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: No bootstrap required, opened a new log
I20260808 08:44:00.024096 9579 tablet_bootstrap.cc:654] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:00.024461 9577 ts_tablet_manager.cc:1397] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.008s
I20260808 08:44:00.025731 9579 log.cc:824] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:00.028538 9576 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: No bootstrap required, opened a new log
I20260808 08:44:00.028889 9576 ts_tablet_manager.cc:1397] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.007s
I20260808 08:44:00.037165 9576 raft_consensus.cc:348] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.037768 9576 raft_consensus.cc:374] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:00.037895 9576 raft_consensus.cc:729] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b7c29b44034f1992880e9d13eba99d, State: Initialized, Role: FOLLOWER
I20260808 08:44:00.038657 9576 consensus_queue.cc:260] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.039247 9577 raft_consensus.cc:348] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.039749 9577 raft_consensus.cc:374] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:00.039872 9577 raft_consensus.cc:729] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f814ac76000e46bbbcebf5a3b43385e8, State: Initialized, Role: FOLLOWER
I20260808 08:44:00.040416 9579 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: No bootstrap required, opened a new log
I20260808 08:44:00.040851 9369 heartbeater.cc:503] Master 127.19.242.254:36009 was elected leader, sending a full tablet report...
I20260808 08:44:00.040681 9577 consensus_queue.cc:260] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.041692 9576 ts_tablet_manager.cc:1428] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 08:44:00.042333 9579 ts_tablet_manager.cc:1397] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Time spent bootstrapping tablet: real 0.023s user 0.013s sys 0.007s
I20260808 08:44:00.043069 9554 heartbeater.cc:503] Master 127.19.242.254:36009 was elected leader, sending a full tablet report...
I20260808 08:44:00.043795 9577 ts_tablet_manager.cc:1428] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Time spent starting tablet: real 0.019s user 0.019s sys 0.001s
I20260808 08:44:00.051815 9579 raft_consensus.cc:348] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.052291 9579 raft_consensus.cc:374] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:00.052446 9579 raft_consensus.cc:729] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c3a9d7b85542fdb7e22285b294a61a, State: Initialized, Role: FOLLOWER
I20260808 08:44:00.053161 9579 consensus_queue.cc:260] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.054874 9579 ts_tablet_manager.cc:1428] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260808 08:44:00.058888 9587 raft_consensus.cc:482] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:00.059227 9587 raft_consensus.cc:504] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.061060 9587 leader_election.cc:288] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837), 29c3a9d7b85542fdb7e22285b294a61a (127.19.242.193:35471)
I20260808 08:44:00.067826 9571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.061466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:46173 (local address 127.19.242.194:45837)
0808 08:44:00.061703 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:00.061710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:00.061876 (+ 166us) server_negotiation.cc:407] Connection header received
0808 08:44:00.062119 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:00.062131 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:00.062207 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:00.062329 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:00.063103 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.063911 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.065798 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.066754 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.066946 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.067031 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:00.067350 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 08:44:00.067505 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:44:00.067947 9559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.061539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45837 (local address 127.19.242.195:46173)
0808 08:44:00.061773 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.061791 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:00.061912 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:00.062360 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:00.062365 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:00.062423 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:00.062904 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:00.062924 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.064089 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.064095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:00.065594 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:00.065611 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.066946 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.066953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:00.067164 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.067191 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:44:00.067307 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:44:00.067471 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 08:44:00.068567 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.062456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:46399 (local address 127.19.242.193:35471)
0808 08:44:00.062686 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:00.062695 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:00.063288 (+ 593us) server_negotiation.cc:407] Connection header received
0808 08:44:00.063492 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:00.063498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:00.063571 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:00.063677 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:00.064245 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.064947 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.066672 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.067504 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.067731 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.067809 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:00.068167 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:44:00.068336 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:44:00.068650 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.062036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.19.242.195:46399)
0808 08:44:00.063125 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.063199 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:00.063358 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:00.063691 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:00.063696 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:00.063720 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:00.064072 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:00.064081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.065105 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.065110 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:00.066498 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:00.066510 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.067738 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.067745 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:00.067960 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.068002 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:44:00.068103 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 08:44:00.068261 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":954,"thread_start_us":705,"threads_started":1}
I20260808 08:44:00.069195 9304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5a21e568d44b6ba92decaca3f0fa85" candidate_uuid: "f814ac76000e46bbbcebf5a3b43385e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b7c29b44034f1992880e9d13eba99d" is_pre_election: true
I20260808 08:44:00.069725 9304 raft_consensus.cc:2454] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f814ac76000e46bbbcebf5a3b43385e8 in term 0.
I20260808 08:44:00.069830 9090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5a21e568d44b6ba92decaca3f0fa85" candidate_uuid: "f814ac76000e46bbbcebf5a3b43385e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c3a9d7b85542fdb7e22285b294a61a" is_pre_election: true
I20260808 08:44:00.070459 9090 raft_consensus.cc:2454] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f814ac76000e46bbbcebf5a3b43385e8 in term 0.
I20260808 08:44:00.070529 9392 leader_election.cc:302] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b7c29b44034f1992880e9d13eba99d, f814ac76000e46bbbcebf5a3b43385e8; no voters:
I20260808 08:44:00.071027 9587 raft_consensus.cc:2781] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:44:00.071199 9587 raft_consensus.cc:482] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:44:00.071321 9587 raft_consensus.cc:3037] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:00.073678 9587 raft_consensus.cc:504] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.074390 9587 leader_election.cc:288] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [CANDIDATE]: Term 1 election: Requested vote from peers 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837), 29c3a9d7b85542fdb7e22285b294a61a (127.19.242.193:35471)
I20260808 08:44:00.075183 9090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5a21e568d44b6ba92decaca3f0fa85" candidate_uuid: "f814ac76000e46bbbcebf5a3b43385e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c3a9d7b85542fdb7e22285b294a61a"
I20260808 08:44:00.075197 9304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de5a21e568d44b6ba92decaca3f0fa85" candidate_uuid: "f814ac76000e46bbbcebf5a3b43385e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07b7c29b44034f1992880e9d13eba99d"
I20260808 08:44:00.075443 9304 raft_consensus.cc:3037] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:00.075443 9090 raft_consensus.cc:3037] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:00.079031 9090 raft_consensus.cc:2454] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f814ac76000e46bbbcebf5a3b43385e8 in term 1.
I20260808 08:44:00.079035 9304 raft_consensus.cc:2454] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f814ac76000e46bbbcebf5a3b43385e8 in term 1.
I20260808 08:44:00.079592 9392 leader_election.cc:302] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07b7c29b44034f1992880e9d13eba99d, f814ac76000e46bbbcebf5a3b43385e8; no voters:
I20260808 08:44:00.079999 9587 raft_consensus.cc:2781] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:44:00.080493 9587 raft_consensus.cc:686] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 LEADER]: Becoming Leader. State: Replica: f814ac76000e46bbbcebf5a3b43385e8, State: Running, Role: LEADER
I20260808 08:44:00.081102 9587 consensus_queue.cc:237] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:00.087352 8864 catalog_manager.cc:5495] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "f814ac76000e46bbbcebf5a3b43385e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } health_report { overall_health: UNKNOWN } } }
W20260808 08:44:00.111483 9174 tablet.cc:2369] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:44:00.113696 9372 tablet.cc:2369] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:44:00.118422 9569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.110902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.19.242.195:37277)
0808 08:44:00.111147 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:00.111152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:00.111198 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:44:00.111537 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:00.111541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:00.111762 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:00.111912 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:44:00.112447 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.113192 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.115656 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.116211 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.116348 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.116955 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:44:00.117576 (+ 621us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:44:00.117718 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:00.117921 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 08:44:00.118072 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:44:00.128623 9304 raft_consensus.cc:1261] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Refusing update from remote peer f814ac76000e46bbbcebf5a3b43385e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:44:00.128882 9090 raft_consensus.cc:1261] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Refusing update from remote peer f814ac76000e46bbbcebf5a3b43385e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:44:00.130390 9587 consensus_queue.cc:1035] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:44:00.130836 9592 consensus_queue.cc:1035] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:44:00.147428 9598 mvcc.cc:205] Tried to move back new op lower bound from 7316187709953454080 to 7316187709777596416. Current Snapshot: MvccSnapshot[applied={T|T < 7316187709953454080}]
I20260808 08:44:00.163161 8864 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:44:00.163550 8864 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:44:00.168129 8864 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Sending DeleteTablet for 3 replicas of tablet de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:00.169637 9267 tablet_service.cc:1514] Processing DeleteTablet for tablet de5a21e568d44b6ba92decaca3f0fa85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:00 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:45668
I20260808 08:44:00.169649 9458 tablet_service.cc:1514] Processing DeleteTablet for tablet de5a21e568d44b6ba92decaca3f0fa85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:00 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:34188
I20260808 08:44:00.170377 9062 tablet_service.cc:1514] Processing DeleteTablet for tablet de5a21e568d44b6ba92decaca3f0fa85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:00 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:52568
I20260808 08:44:00.171622 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 8922
I20260808 08:44:00.186290 9615 tablet_replica.cc:330] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: stopping tablet replica
I20260808 08:44:00.190215 9613 tablet_replica.cc:330] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: stopping tablet replica
I20260808 08:44:00.190682 9613 raft_consensus.cc:2229] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:44:00.191334 9610 tablet_replica.cc:330] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: stopping tablet replica
I20260808 08:44:00.191596 9613 raft_consensus.cc:2258] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:00.189502 9615 raft_consensus.cc:2229] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:44:00.192054 9610 raft_consensus.cc:2229] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:44:00.192724 9610 raft_consensus.cc:2258] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:00.192727 9615 raft_consensus.cc:2258] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:00.195644 9610 ts_tablet_manager.cc:1905] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:00.196708 9573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.173873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52576 (local address 127.19.242.193:35471)
0808 08:44:00.174087 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:00.174095 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:00.174120 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:44:00.174198 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:00.174204 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:00.174307 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:00.174437 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:00.177012 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.178386 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.181050 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.181840 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.182021 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.186925 (+ 4904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:00.186941 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:00.186962 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:00.187014 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:00.191836 (+ 4822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:00.193022 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:00.193035 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:00.193039 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:00.193240 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:00.194112 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:00.194119 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:00.194123 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:00.194684 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:00.195080 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:00.195575 (+ 495us) server_negotiation.cc:299] Negotiation successful
0808 08:44:00.196004 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:44:00.196988 9613 ts_tablet_manager.cc:1905] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:00.197543 9166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:00.204833 9610 ts_tablet_manager.cc:1918] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:44:00.205206 9610 log.cc:1196] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:00.205701 9613 ts_tablet_manager.cc:1918] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:44:00.205922 9613 log.cc:1196] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:00.206204 9610 ts_tablet_manager.cc:1939] T de5a21e568d44b6ba92decaca3f0fa85 P 07b7c29b44034f1992880e9d13eba99d: Deleting consensus metadata
I20260808 08:44:00.206673 9613 ts_tablet_manager.cc:1939] T de5a21e568d44b6ba92decaca3f0fa85 P f814ac76000e46bbbcebf5a3b43385e8: Deleting consensus metadata
I20260808 08:44:00.208717 8839 catalog_manager.cc:4841] TS 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837): tablet de5a21e568d44b6ba92decaca3f0fa85 (table test-table [id=ab8042cbe70e4781b5ac9373e8d51a7a]) successfully deleted
I20260808 08:44:00.208739 8844 catalog_manager.cc:4841] TS f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277): tablet de5a21e568d44b6ba92decaca3f0fa85 (table test-table [id=ab8042cbe70e4781b5ac9373e8d51a7a]) successfully deleted
I20260808 08:44:00.206380 9615 ts_tablet_manager.cc:1905] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:00.304037 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 8922
W20260808 08:44:00.337352 8839 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.242.193:35471 (error 108)
I20260808 08:44:00.340672 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 9177
I20260808 08:44:00.341082 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.340567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52586)
0808 08:44:00.340750 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.340887 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:44:00.341472 8839 catalog_manager.cc:4584] TS 29c3a9d7b85542fdb7e22285b294a61a (127.19.242.193:35471): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet de5a21e568d44b6ba92decaca3f0fa85: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
I20260808 08:44:00.359187 9571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.341691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45684 (local address 127.19.242.194:45837)
0808 08:44:00.341886 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:00.341893 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:00.342012 (+ 119us) server_negotiation.cc:407] Connection header received
0808 08:44:00.342212 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:00.342218 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:00.342304 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:00.342419 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:00.344340 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.345539 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.347769 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.348212 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.348332 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.352181 (+ 3849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:00.352200 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:00.352218 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:00.352269 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:00.355585 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:00.356606 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:00.356615 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:00.356617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:00.356768 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:00.357282 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:00.357287 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:00.357289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:00.357739 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:00.358009 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:00.358439 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 08:44:00.358797 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:44:00.360103 9364 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:00.396067 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.395483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52598)
0808 08:44:00.395757 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.395878 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 08:44:00.397498 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.396986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52608)
0808 08:44:00.397177 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.397303 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 08:44:00.456935 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 9177
I20260808 08:44:00.464162 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.457610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52624)
0808 08:44:00.463637 (+ 6027us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.463927 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5815}
I20260808 08:44:00.466204 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.465402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52638)
0808 08:44:00.465765 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.465905 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 08:44:00.485355 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 9374
I20260808 08:44:00.503104 9569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.486263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34196 (local address 127.19.242.195:37277)
0808 08:44:00.486473 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:00.486480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:00.486655 (+ 175us) server_negotiation.cc:407] Connection header received
0808 08:44:00.486929 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:00.486938 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:00.487020 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:00.487137 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:00.488596 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.489471 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.491024 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:00.491515 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:00.491681 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:00.494750 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:00.494771 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:00.494792 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:00.494859 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:00.499029 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:00.500319 (+ 1290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:00.500329 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:00.500332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:00.500556 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:00.501098 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:00.501111 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:00.501114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:00.501558 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:00.501974 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:00.502360 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 08:44:00.502630 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:44:00.504026 9543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:00.547820 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.547215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52648)
0808 08:44:00.547500 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.547620 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260808 08:44:00.549273 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.548765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52652)
0808 08:44:00.549000 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.549103 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260808 08:44:00.632721 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 9374
I20260808 08:44:00.663977 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 8812
I20260808 08:44:00.665246 8904 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:00.783810 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:00.782924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:35471 (local address 127.0.0.1:52654)
0808 08:44:00.783381 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:00.783520 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:35471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 08:44:00.784166 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 8812
I20260808 08:44:00.816751 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36009
--webserver_interface=127.19.242.254
--webserver_port=35061
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:44:01.190516 9624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:01.190886 9624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:01.191076 9624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:01.198987 9624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:44:01.199131 9624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:01.199231 9624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:01.199337 9624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:44:01.199409 9624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:44:01.209969 9624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=35061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:01.211585 9624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:01.213083 9624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:01.226171 9631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:01.226279 9633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:01.226243 9630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:01.227869 9624 server_base.cc:1034] running on GCE node
I20260808 08:44:01.228890 9624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:01.230647 9624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:01.231995 9624 hybrid_clock.cc:648] HybridClock initialized: now 1786178641231929 us; error 51 us; skew 500 ppm
I20260808 08:44:01.232554 9624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:01 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:01.236958 9624 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:44:01.239584 9624 webserver.cc:460] Webserver started at http://127.19.242.254:35061/ using document root <none> and password file <none>
I20260808 08:44:01.240907 9624 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:01.241118 9624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:01.250836 9624 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:44:01.254688 9644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:01.256608 9624 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:44:01.256803 9624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "7083e294617e45778ebca11786df8955"
format_stamp: "Formatted at 2026-08-08 08:43:54 on dist-test-slave-39l8"
server_key: "f3d2d12d2d8819bc85cc53a4c0234227"
server_key_iv: "5ef8ffd69a16b5bc15cc91c5c05d43ec"
server_key_version: "encryptionkey@0"
I20260808 08:44:01.257894 9624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:01.280076 9624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:01.284888 9624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:01.285149 9624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:01.306625 9624 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36009
I20260808 08:44:01.306648 9717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36009 every 8 connection(s)
I20260808 08:44:01.308424 9624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:44:01.310081 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 9624
I20260808 08:44:01.311077 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:35471
--local_ip_for_outbound_sockets=127.19.242.193
--tserver_master_addrs=127.19.242.254:36009
--webserver_port=36075
--webserver_interface=127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:44:01.317289 9719 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:44:01.321409 9719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Bootstrap starting.
I20260808 08:44:01.359442 9719 log.cc:824] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:01.385103 9719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:44:01.385962 9719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955: Bootstrap complete.
I20260808 08:44:01.402107 9719 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:44:01.403362 9719 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7083e294617e45778ebca11786df8955, State: Initialized, Role: FOLLOWER
I20260808 08:44:01.404150 9719 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:44:01.404454 9719 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:44:01.404608 9719 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:44:01.404832 9719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:44:01.409668 9719 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:44:01.410413 9719 leader_election.cc:302] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7083e294617e45778ebca11786df8955; no voters:
I20260808 08:44:01.411252 9719 leader_election.cc:288] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:44:01.411445 9724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:44:01.412856 9724 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [term 3 LEADER]: Becoming Leader. State: Replica: 7083e294617e45778ebca11786df8955, State: Running, Role: LEADER
I20260808 08:44:01.413789 9719 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:44:01.413630 9724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } }
I20260808 08:44:01.416478 9725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7083e294617e45778ebca11786df8955" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } } }
I20260808 08:44:01.416878 9725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: This master's current role is: LEADER
I20260808 08:44:01.420395 9727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7083e294617e45778ebca11786df8955. Latest consensus state: current_term: 3 leader_uuid: "7083e294617e45778ebca11786df8955" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7083e294617e45778ebca11786df8955" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36009 } } }
I20260808 08:44:01.420747 9727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7083e294617e45778ebca11786df8955 [sys.catalog]: This master's current role is: LEADER
I20260808 08:44:01.422457 9730 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:44:01.435842 9730 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:44:01.439029 9730 catalog_manager.cc:1259] Loaded cluster ID: 274ce40dcb3e4ef29f7af7f391b2ff5d
I20260808 08:44:01.439335 9730 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 08:44:01.443091 9730 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4abcf529ad google::LogMessage::Fail() at ??:0
@ 0x7f4abcf5588a google::LogMessage::SendToLog() at ??:0
@ 0x7f4abcf524de google::LogMessage::Flush() at ??:0
@ 0x7f4abcf53a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4ad2989512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f4ad2986976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4ad2a0e610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f4ad2a0e439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f4abfb9e345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4abfba191c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f4abfba1799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f4abfb7ceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4ac2e566db start_thread at ??:0
@ 0x7f4abbdec61f clone at ??:0
W20260808 08:44:01.763696 9722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:01.764081 9722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:01.764284 9722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:01.772778 9722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:01.772965 9722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:01.773159 9722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:44:01.785488 9722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:35471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=36075
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:01.787066 9722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:01.788560 9722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:01.803066 9779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:01.803123 9786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:01.803099 9780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:01.805161 9722 server_base.cc:1034] running on GCE node
I20260808 08:44:01.805933 9722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:01.807602 9722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:01.808869 9722 hybrid_clock.cc:648] HybridClock initialized: now 1786178641808825 us; error 47 us; skew 500 ppm
I20260808 08:44:01.809347 9722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:01 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:01.813031 9722 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:44:01.815022 9722 webserver.cc:460] Webserver started at http://127.19.242.193:36075/ using document root <none> and password file <none>
I20260808 08:44:01.815873 9722 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:01.816037 9722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:01.822290 9722 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 08:44:01.826211 9797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:01.827811 9722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:44:01.828028 9722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "29c3a9d7b85542fdb7e22285b294a61a"
format_stamp: "Formatted at 2026-08-08 08:43:55 on dist-test-slave-39l8"
server_key: "193e1e5d3c0292444e68c5bf458b0602"
server_key_iv: "1a2995bf0d5971a4f3080f71278c48c7"
server_key_version: "encryptionkey@0"
I20260808 08:44:01.829138 9722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:01.862995 9722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:01.867844 9722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:01.868356 9722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:01.869614 9722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:01.872051 9807 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260808 08:44:01.878491 9722 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:44:01.878664 9722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260808 08:44:01.878923 9722 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:44:01.882642 9722 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:44:01.882833 9722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.003s
I20260808 08:44:01.883311 9807 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Bootstrap starting.
I20260808 08:44:01.893977 9807 log.cc:824] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:01.909997 9807 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:44:01.911123 9807 tablet_bootstrap.cc:492] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Bootstrap complete.
I20260808 08:44:01.911679 9807 ts_tablet_manager.cc:1397] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.011s
I20260808 08:44:01.921840 9807 raft_consensus.cc:348] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:01.923071 9807 raft_consensus.cc:729] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c3a9d7b85542fdb7e22285b294a61a, State: Initialized, Role: FOLLOWER
I20260808 08:44:01.923866 9807 consensus_queue.cc:260] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:01.925714 9807 ts_tablet_manager.cc:1428] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
I20260808 08:44:01.938237 9722 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:35471
I20260808 08:44:01.938298 9966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:35471 every 8 connection(s)
I20260808 08:44:01.939746 9722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:44:01.942278 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 9722
I20260808 08:44:01.943253 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:45837
--local_ip_for_outbound_sockets=127.19.242.194
--tserver_master_addrs=127.19.242.254:36009
--webserver_port=45737
--webserver_interface=127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:44:01.945753 9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:01.943548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:49961)
0808 08:44:01.944502 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:01.944786 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":401,"threads_started":1}
W20260808 08:44:01.946635 9969 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:36009 (0 consecutive failures): Network error: Failed to ping master at 127.19.242.254:36009: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
I20260808 08:44:01.947700 9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:01.947317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:46921)
0808 08:44:01.947493 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:01.947576 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:44:01.948875 9971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:01.948409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:46285)
0808 08:44:01.948638 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:01.948732 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260808 08:44:01.949288 9969 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:44:02.352198 9972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:02.352550 9972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:02.352675 9972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:02.361275 9972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:02.361415 9972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:02.361538 9972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:44:02.371858 9972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:45837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=45737
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:02.373261 9972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:02.374631 9972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:02.390465 9980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:02.390676 9977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:02.390628 9978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:02.391582 9972 server_base.cc:1034] running on GCE node
I20260808 08:44:02.392329 9972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:02.393584 9972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:02.394850 9972 hybrid_clock.cc:648] HybridClock initialized: now 1786178642394806 us; error 33 us; skew 500 ppm
I20260808 08:44:02.395236 9972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:02 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:02.399341 9972 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:44:02.401141 9972 webserver.cc:460] Webserver started at http://127.19.242.194:45737/ using document root <none> and password file <none>
I20260808 08:44:02.402104 9972 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:02.402278 9972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:02.408614 9972 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:44:02.411995 9989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:02.413622 9972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:44:02.413861 9972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "07b7c29b44034f1992880e9d13eba99d"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "4610d23df29a7737d5f99aa044a4267b"
server_key_iv: "076f0ab670cdbcd6882eb8c06d97cf85"
server_key_version: "encryptionkey@0"
I20260808 08:44:02.415082 9972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:02.446668 9972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:02.452131 9972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:02.452493 9972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:02.453678 9972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:02.455390 9972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:02.455523 9972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:02.455698 9972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:02.455807 9972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:02.493577 9972 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:45837
I20260808 08:44:02.493680 10150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:45837 every 8 connection(s)
I20260808 08:44:02.495332 9972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:44:02.500986 10155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:02.498894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:58397)
0808 08:44:02.499816 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:02.500067 (+ 251us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":353,"threads_started":1}
W20260808 08:44:02.501832 10152 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:36009 (0 consecutive failures): Network error: Failed to ping master at 127.19.242.254:36009: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
I20260808 08:44:02.502902 10155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:02.502431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:50899)
0808 08:44:02.502603 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:02.502683 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:44:02.503400 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 9972
I20260808 08:44:02.504040 10155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:02.503618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:57957)
0808 08:44:02.503777 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:02.503887 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:44:02.504262 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:37277
--local_ip_for_outbound_sockets=127.19.242.195
--tserver_master_addrs=127.19.242.254:36009
--webserver_port=40565
--webserver_interface=127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:44:02.504356 10152 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:44:02.868914 10157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:02.869264 10157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:02.869475 10157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:02.877055 10157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:02.877185 10157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:02.877413 10157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:44:02.887820 10157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:37277
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=40565
--tserver_master_addrs=127.19.242.254:36009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:02.889237 10157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:02.890672 10157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:02.905042 10167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:02.905108 10162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:02.905071 10165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:02.906105 10157 server_base.cc:1034] running on GCE node
I20260808 08:44:02.906929 10157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:02.907971 10157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:02.909204 10157 hybrid_clock.cc:648] HybridClock initialized: now 1786178642909161 us; error 52 us; skew 500 ppm
I20260808 08:44:02.909548 10157 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:02 dist-test-slave-39l8 krb5kdc[7985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:02.913043 10157 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:44:02.915405 10157 webserver.cc:460] Webserver started at http://127.19.242.195:40565/ using document root <none> and password file <none>
I20260808 08:44:02.916184 10157 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:02.916356 10157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:02.922353 10157 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 08:44:02.925431 10174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:02.927026 10157 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:44:02.927227 10157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "f814ac76000e46bbbcebf5a3b43385e8"
format_stamp: "Formatted at 2026-08-08 08:43:56 on dist-test-slave-39l8"
server_key: "7e550fb89cb433289de16c26b955d43c"
server_key_iv: "5eae4c1a8168446f9e52690dee4a0c00"
server_key_version: "encryptionkey@0"
I20260808 08:44:02.928238 10157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:02.950843 10180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:02.949952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:49699)
0808 08:44:02.950429 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:02.950528 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":215,"threads_started":1}
I20260808 08:44:02.968261 10157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:02.972692 10157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:02.973004 10157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:02.974056 10157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:02.975700 10157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:02.975863 10157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:02.976018 10157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:02.976138 10157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:03.013427 10157 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:37277
I20260808 08:44:03.013528 10348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:37277 every 8 connection(s)
I20260808 08:44:03.015086 10157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:44:03.019521 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 10157
I20260808 08:44:03.021806 10355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.018899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:50635)
0808 08:44:03.019978 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:03.020359 (+ 381us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":428,"threads_started":1}
W20260808 08:44:03.022548 10350 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:36009 (0 consecutive failures): Network error: Failed to ping master at 127.19.242.254:36009: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
I20260808 08:44:03.023540 10355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.023168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:45431)
0808 08:44:03.023343 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:03.023418 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 08:44:03.024502 10355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.024077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:49869)
0808 08:44:03.024279 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:03.024374 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260808 08:44:03.024823 10350 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:44:03.505962 10359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.505034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:40881)
0808 08:44:03.505562 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:03.505697 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":253,"threads_started":1}
I20260808 08:44:03.543141 10361 raft_consensus.cc:482] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:03.543514 10361 raft_consensus.cc:504] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:03.545164 10361 leader_election.cc:288] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277), 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837)
Aug 08 08:44:03 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
Aug 08 08:44:03 dist-test-slave-39l8 krb5kdc[7985](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:44:03.586519 10367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.545598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:45837 (local address 127.19.242.193:57647)
0808 08:44:03.560575 (+ 14977us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:03.560599 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:03.560721 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:03.564378 (+ 3657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:03.564381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:03.565106 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:03.565825 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:03.565848 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.567560 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.567565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:03.569081 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:03.569096 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.570340 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.570350 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:03.570543 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:03.574945 (+ 4402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:03.574983 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:03.578548 (+ 3565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:03.582377 (+ 3829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:03.582383 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:03.582387 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:03.583116 (+ 729us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:03.583624 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:03.583629 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:03.583633 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:03.583909 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:03.584799 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:03.584807 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:03.585162 (+ 355us) client_negotiation.cc:769] Sending connection context
0808 08:44:03.585449 (+ 287us) client_negotiation.cc:240] Negotiation successful
0808 08:44:03.586003 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14833,"mutex_wait_us":138,"spinlock_wait_cycles":27008,"thread_start_us":15310,"threads_started":1}
I20260808 08:44:03.586540 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.545937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:57647 (local address 127.19.242.194:45837)
0808 08:44:03.561255 (+ 15318us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:03.561272 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:03.561328 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:44:03.563008 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:03.563019 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:03.563386 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:03.563780 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:03.566056 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.567357 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.569274 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.570022 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.570267 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:03.578929 (+ 8662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:03.578938 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:03.578952 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:03.578998 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:03.582200 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:03.583287 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:03.583296 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:03.583303 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:03.583483 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:03.584053 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:03.584057 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:03.584059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:03.584625 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:03.584894 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:03.585710 (+ 816us) server_negotiation.cc:299] Negotiation successful
0808 08:44:03.586137 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15099,"thread_start_us":14904,"threads_started":1}
I20260808 08:44:03.586617 10368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.545867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:60199 (local address 127.19.242.195:37277)
0808 08:44:03.561423 (+ 15556us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:03.561438 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:03.561484 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:44:03.562973 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:03.562985 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:03.563386 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:03.563761 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:03.566057 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.567327 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.569277 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.569994 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.570238 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:03.578696 (+ 8458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:03.578757 (+ 61us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:03.578786 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:03.578835 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:03.582054 (+ 3219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:03.583320 (+ 1266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:03.583327 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:03.583333 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:03.583520 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:03.584044 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:03.584050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:03.584053 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:03.584626 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:03.584838 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:03.585716 (+ 878us) server_negotiation.cc:299] Negotiation successful
0808 08:44:03.586150 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15375,"thread_start_us":15380,"threads_started":1}
I20260808 08:44:03.587751 10362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.545544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:37277 (local address 127.19.242.193:60199)
0808 08:44:03.559672 (+ 14128us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:03.559761 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:03.560567 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:03.563920 (+ 3353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:03.563932 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:03.565053 (+ 1121us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:03.565824 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:03.565847 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.567556 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.567561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:03.569074 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:03.569089 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:03.570248 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:03.570256 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:03.570515 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:03.574946 (+ 4431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:03.574991 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:03.578276 (+ 3285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:03.582267 (+ 3991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:03.582277 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:03.582301 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:03.583105 (+ 804us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:03.583656 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:03.583661 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:03.583665 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:03.583909 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:03.584798 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:03.584807 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:03.585162 (+ 355us) client_negotiation.cc:769] Sending connection context
0808 08:44:03.585449 (+ 287us) client_negotiation.cc:240] Negotiation successful
0808 08:44:03.586186 (+ 737us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13887,"mutex_wait_us":160,"spinlock_wait_cycles":31488,"thread_start_us":15344,"threads_started":1}
W20260808 08:44:03.590766 9798 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
W20260808 08:44:03.591037 9801 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:03.591228 9801 leader_election.cc:302] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c3a9d7b85542fdb7e22285b294a61a; no voters: 07b7c29b44034f1992880e9d13eba99d, f814ac76000e46bbbcebf5a3b43385e8
I20260808 08:44:03.591686 10361 raft_consensus.cc:2726] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:44:03.952452 10362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:03.951918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:55341)
0808 08:44:03.952170 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:03.952289 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 08:44:04.026418 10370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:04.025426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:44395)
0808 08:44:04.025933 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:04.026102 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":238,"threads_started":1}
I20260808 08:44:04.507805 10371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:04.507030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:38391)
0808 08:44:04.507535 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:04.507623 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":280,"threads_started":1}
I20260808 08:44:04.954521 10372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:04.953657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:35773)
0808 08:44:04.954215 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:04.954316 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":262,"threads_started":1}
I20260808 08:44:05.028680 10374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:05.027798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:49423)
0808 08:44:05.028383 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:05.028491 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":337,"threads_started":1}
I20260808 08:44:05.509678 10375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:05.508884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:49765)
0808 08:44:05.509392 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:05.509483 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":265,"threads_started":1}
I20260808 08:44:05.622462 10376 raft_consensus.cc:482] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:05.622756 10376 raft_consensus.cc:504] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:05.623545 10376 leader_election.cc:288] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277), 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837)
W20260808 08:44:05.624572 9798 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
W20260808 08:44:05.624787 9801 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:05.624886 9801 leader_election.cc:302] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c3a9d7b85542fdb7e22285b294a61a; no voters: 07b7c29b44034f1992880e9d13eba99d, f814ac76000e46bbbcebf5a3b43385e8
I20260808 08:44:05.625173 10376 raft_consensus.cc:2726] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:44:05.956498 10377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:05.955676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:55395)
0808 08:44:05.956188 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:05.956300 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":262,"threads_started":1}
I20260808 08:44:06.030573 10378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:06.029804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:34477)
0808 08:44:06.030308 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:06.030401 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":262,"threads_started":1}
I20260808 08:44:06.511593 10380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:06.510777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:39389)
0808 08:44:06.511302 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:06.511402 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":259,"threads_started":1}
I20260808 08:44:06.958638 10382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:06.957712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:41145)
0808 08:44:06.958326 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:06.958435 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":260,"threads_started":1}
I20260808 08:44:07.032677 10383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:07.031742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:46193)
0808 08:44:07.032309 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:07.032406 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":251,"threads_started":1}
I20260808 08:44:07.513972 10384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:07.512690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:60313)
0808 08:44:07.513702 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:07.513800 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":894,"thread_start_us":741,"threads_started":1}
I20260808 08:44:07.960662 10386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:07.959876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:53437)
0808 08:44:07.960379 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:07.960477 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":261,"threads_started":1}
I20260808 08:44:08.034583 10388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:08.033776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:41615)
0808 08:44:08.034310 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:08.034416 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":235,"threads_started":1}
I20260808 08:44:08.516418 10391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:08.515308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:45473)
0808 08:44:08.516125 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:08.516210 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":509,"threads_started":1}
I20260808 08:44:08.963080 10392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:08.961959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:57023)
0808 08:44:08.962619 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:08.962799 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":389,"threads_started":1}
I20260808 08:44:08.977195 10393 raft_consensus.cc:482] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:08.977442 10393 raft_consensus.cc:504] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:08.978232 10393 leader_election.cc:288] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277), 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837)
W20260808 08:44:08.979350 9801 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
W20260808 08:44:08.979533 9798 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:08.979636 9798 leader_election.cc:302] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c3a9d7b85542fdb7e22285b294a61a; no voters: 07b7c29b44034f1992880e9d13eba99d, f814ac76000e46bbbcebf5a3b43385e8
I20260808 08:44:08.979879 10393 raft_consensus.cc:2726] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:44:09.036484 10395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:09.035669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:37939)
0808 08:44:09.036181 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:09.036297 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":273,"threads_started":1}
I20260808 08:44:09.518524 10396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:09.517471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:59399)
0808 08:44:09.518214 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:09.518316 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":394,"threads_started":1}
I20260808 08:44:09.964879 10397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:09.964115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:37895)
0808 08:44:09.964623 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:09.964710 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":278,"threads_started":1}
I20260808 08:44:10.038652 10398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:10.037731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:39427)
0808 08:44:10.038349 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:10.038447 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":252,"threads_started":1}
I20260808 08:44:10.520638 10399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:10.519548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:42137)
0808 08:44:10.520307 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:10.520408 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":403,"threads_started":1}
I20260808 08:44:10.966852 10400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:10.965929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:57435)
0808 08:44:10.966487 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:10.966578 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":320,"threads_started":1}
I20260808 08:44:11.040618 10402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:11.039864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:34621)
0808 08:44:11.040334 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:11.040428 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":236,"threads_started":1}
I20260808 08:44:11.522763 10403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:11.521697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:49237)
0808 08:44:11.522441 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:11.522546 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":335,"threads_started":1}
I20260808 08:44:11.969338 10404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:11.968308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:33649)
0808 08:44:11.968979 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:11.969115 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":369,"threads_started":1}
I20260808 08:44:12.042568 10405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:12.041750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:50135)
0808 08:44:12.042307 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:12.042406 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":272,"threads_started":1}
I20260808 08:44:12.524641 10406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:12.523844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:44445)
0808 08:44:12.524345 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:12.524434 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":241,"threads_started":1}
I20260808 08:44:12.575500 10407 raft_consensus.cc:482] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:12.575721 10407 raft_consensus.cc:504] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:12.576488 10407 leader_election.cc:288] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277), 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837)
W20260808 08:44:12.577617 9801 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
W20260808 08:44:12.577850 9798 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:12.578011 9798 leader_election.cc:302] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c3a9d7b85542fdb7e22285b294a61a; no voters: 07b7c29b44034f1992880e9d13eba99d, f814ac76000e46bbbcebf5a3b43385e8
I20260808 08:44:12.578356 10407 raft_consensus.cc:2726] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:44:12.971504 10408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:12.970537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:44559)
0808 08:44:12.971185 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:12.971313 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":333,"threads_started":1}
I20260808 08:44:13.044560 10409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:13.043758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:44525)
0808 08:44:13.044275 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:13.044366 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":272,"threads_started":1}
I20260808 08:44:13.526500 10411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:13.525690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:46883)
0808 08:44:13.526229 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:13.526330 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":261,"threads_started":1}
I20260808 08:44:13.973483 10412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:13.972690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:54627)
0808 08:44:13.973176 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:13.973317 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":248,"threads_started":1}
I20260808 08:44:14.046582 10414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:14.045665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:49715)
0808 08:44:14.046253 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:14.046376 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":302,"threads_started":1}
I20260808 08:44:14.528546 10415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:14.527568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:57345)
0808 08:44:14.528203 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:14.528342 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":371,"threads_started":1}
I20260808 08:44:14.975391 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:14.974532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:44043)
0808 08:44:14.975093 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:14.975201 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":335,"threads_started":1}
I20260808 08:44:15.048810 10418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:15.047825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:35317)
0808 08:44:15.048490 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:15.048599 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":409,"threads_started":1}
I20260808 08:44:15.530624 10419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:15.529779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:52571)
0808 08:44:15.530348 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:15.530448 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":319,"threads_started":1}
I20260808 08:44:15.977605 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:15.976618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:51289)
0808 08:44:15.977190 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:15.977348 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":327,"threads_started":1}
I20260808 08:44:16.050972 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:16.049900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:55393)
0808 08:44:16.050459 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:16.050570 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":292,"threads_started":1}
I20260808 08:44:16.533066 10423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:16.531878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:48245)
0808 08:44:16.532644 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:16.532801 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":379,"threads_started":1}
I20260808 08:44:16.980297 10424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:16.979366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:38469)
0808 08:44:16.979937 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:16.980045 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":280,"threads_started":1}
I20260808 08:44:16.993672 10425 raft_consensus.cc:482] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:16.993898 10425 raft_consensus.cc:504] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f814ac76000e46bbbcebf5a3b43385e8" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 37277 } } peers { permanent_uuid: "07b7c29b44034f1992880e9d13eba99d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 45837 } } peers { permanent_uuid: "29c3a9d7b85542fdb7e22285b294a61a" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 35471 } }
I20260808 08:44:16.994668 10425 leader_election.cc:288] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277), 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837)
W20260808 08:44:16.995893 9798 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 07b7c29b44034f1992880e9d13eba99d (127.19.242.194:45837): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
W20260808 08:44:16.996114 9801 leader_election.cc:341] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f814ac76000e46bbbcebf5a3b43385e8 (127.19.242.195:37277): Not found: Tablet not found: de5a21e568d44b6ba92decaca3f0fa85
I20260808 08:44:16.996222 9801 leader_election.cc:302] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29c3a9d7b85542fdb7e22285b294a61a; no voters: 07b7c29b44034f1992880e9d13eba99d, f814ac76000e46bbbcebf5a3b43385e8
I20260808 08:44:16.996472 10425 raft_consensus.cc:2726] T de5a21e568d44b6ba92decaca3f0fa85 P 29c3a9d7b85542fdb7e22285b294a61a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:44:17.053465 10427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:17.052301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:35709)
0808 08:44:17.052926 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:17.053129 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":367,"threads_started":1}
I20260808 08:44:17.535384 10428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:17.534510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.194:59249)
0808 08:44:17.535088 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:17.535186 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":315,"threads_started":1}
I20260808 08:44:17.982342 10431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:17.981488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.193:48077)
0808 08:44:17.982041 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:17.982141 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":302,"threads_started":1}
I20260808 08:44:18.024986 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 9722
I20260808 08:44:18.049624 10432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:18.026513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42386 (local address 127.19.242.193:35471)
0808 08:44:18.027321 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:18.027333 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:18.027374 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:44:18.027465 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:18.027475 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:18.027756 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:18.027969 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:18.029687 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:18.030835 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:18.032330 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:18.033053 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:18.033248 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:18.042530 (+ 9282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:18.042553 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:18.042571 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:18.042623 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:18.046013 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:18.047097 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:18.047107 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:18.047109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:18.047279 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:18.047779 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:18.047783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:18.047785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:18.048202 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:18.048568 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:18.048939 (+ 371us) server_negotiation.cc:299] Negotiation successful
0808 08:44:18.049249 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":749,"threads_started":1}
I20260808 08:44:18.051301 9960 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:18.056082 10434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:18.055080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36009 (local address 127.19.242.195:38761)
0808 08:44:18.055691 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:18.055834 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":287,"threads_started":1}
I20260808 08:44:18.151187 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 9722
I20260808 08:44:18.183033 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 9972
I20260808 08:44:18.198144 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:18.183873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52644 (local address 127.19.242.194:45837)
0808 08:44:18.184477 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:18.184489 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:18.184509 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:44:18.184570 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:18.184575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:18.184638 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:18.184740 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:18.186277 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:18.187308 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:18.188684 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:18.189163 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:18.189292 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:18.192336 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:18.192343 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:18.192346 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:18.192400 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:18.195384 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:18.196120 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:18.196125 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:18.196127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:18.196310 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:18.196708 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:18.196712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:18.196714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:18.197005 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:18.197227 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:18.197506 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:44:18.197698 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":356,"threads_started":1}
I20260808 08:44:18.199224 10143 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:18.288650 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 9972
I20260808 08:44:18.316959 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 10157
I20260808 08:44:18.333039 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:18.318075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39022 (local address 127.19.242.195:37277)
0808 08:44:18.318838 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:18.318843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:18.318863 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:44:18.318923 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:18.318926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:18.318993 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:18.319101 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:18.320689 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:18.321566 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:18.323071 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:18.323548 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:18.323653 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:18.326514 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:18.326519 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:18.326523 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:18.326583 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:18.329777 (+ 3194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:18.330601 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:18.330606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:18.330608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:18.330864 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:18.331295 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:18.331299 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:18.331301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:18.331633 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:18.331870 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:18.332370 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 08:44:18.332573 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":369,"threads_started":1}
I20260808 08:44:18.333879 10343 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:18.421725 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 10157
2026-08-08T08:44:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25670 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:44:18 dist-test-slave-39l8 krb5kdc[10445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:44:18 dist-test-slave-39l8 krb5kdc[10445](info): set up 2 sockets
Aug 08 08:44:18 dist-test-slave-39l8 krb5kdc[10445](info): commencing operation
krb5kdc: starting...
W20260808 08:44:19.792183 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.004s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:44:20 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:44:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:44:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:44:20.143424 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36319
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:44:20.526863 10469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:20.527213 10469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:20.527309 10469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:20.534893 10469 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:44:20.535022 10469 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:44:20.535063 10469 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:44:20.535125 10469 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:44:20.535181 10469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:20.535255 10469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:20.535302 10469 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:44:20.535358 10469 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:44:20.545758 10469 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:20.547176 10469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:20.548758 10469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:20.561671 10476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:20.561671 10477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:20.561704 10484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:20.562794 10469 server_base.cc:1034] running on GCE node
I20260808 08:44:20.563764 10469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:20.565415 10469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:20.566740 10469 hybrid_clock.cc:648] HybridClock initialized: now 1786178660566607 us; error 66 us; skew 500 ppm
I20260808 08:44:20.567162 10469 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:20 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178660, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:20.570573 10469 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:44:20.572377 10469 webserver.cc:460] Webserver started at http://127.19.242.254:33935/ using document root <none> and password file <none>
I20260808 08:44:20.573128 10469 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:20.573226 10469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:20.573506 10469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:44:20.576889 10469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "3003862655eb4c83b3428df3b9292bd2"
format_stamp: "Formatted at 2026-08-08 08:44:20 on dist-test-slave-39l8"
server_key: "7c0a94f6e5e2b758621db209bdb93362"
server_key_iv: "5c682b9401e9fc17bb410e2f4c8101e4"
server_key_version: "encryptionkey@0"
I20260808 08:44:20.577781 10469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "3003862655eb4c83b3428df3b9292bd2"
format_stamp: "Formatted at 2026-08-08 08:44:20 on dist-test-slave-39l8"
server_key: "7c0a94f6e5e2b758621db209bdb93362"
server_key_iv: "5c682b9401e9fc17bb410e2f4c8101e4"
server_key_version: "encryptionkey@0"
I20260808 08:44:20.583827 10469 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:44:20.587845 10497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:20.589461 10469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:44:20.589689 10469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "3003862655eb4c83b3428df3b9292bd2"
format_stamp: "Formatted at 2026-08-08 08:44:20 on dist-test-slave-39l8"
server_key: "7c0a94f6e5e2b758621db209bdb93362"
server_key_iv: "5c682b9401e9fc17bb410e2f4c8101e4"
server_key_version: "encryptionkey@0"
I20260808 08:44:20.589946 10469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:20.611491 10469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:20.616743 10469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:20.617097 10469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:20.638890 10469 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36319
I20260808 08:44:20.638949 10578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36319 every 8 connection(s)
I20260808 08:44:20.640440 10469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:44:20.644536 10579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:20.649277 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 10469
I20260808 08:44:20.649531 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:44:20.650463 20427 external_mini_cluster.cc:1428] Setting key 5620bedccfc89d724837982397931948
I20260808 08:44:20.658089 10579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Bootstrap starting.
I20260808 08:44:20.662120 10579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:20.663480 10579 log.cc:824] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:20.666778 10579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: No bootstrap required, opened a new log
Aug 08 08:44:20 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:44:20.675344 10579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:20.675832 10579 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:20.675966 10579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3003862655eb4c83b3428df3b9292bd2, State: Initialized, Role: FOLLOWER
I20260808 08:44:20.676645 10579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:20.676909 10579 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:44:20.677062 10579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:44:20.677260 10579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:20.677460 10585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:20.652976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35514 (local address 127.19.242.254:36319)
0808 08:44:20.653874 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:20.653890 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:20.653934 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:44:20.656333 (+ 2399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:20.656361 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:20.656838 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:20.657224 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:20.659355 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:20.660750 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:20.662849 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:20.663615 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:20.663871 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:20.668497 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:20.668506 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:20.668526 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:20.668575 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:20.672261 (+ 3686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:20.673151 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:20.673164 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:20.673172 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:20.673396 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:20.673876 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:20.673881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:20.673883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:20.674530 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:20.674898 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:20.675418 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 08:44:20.676015 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":414,"threads_started":1}
I20260808 08:44:20.679943 10579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:20.680557 10579 leader_election.cc:302] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3003862655eb4c83b3428df3b9292bd2; no voters:
I20260808 08:44:20.681227 10579 leader_election.cc:288] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:44:20.681450 10588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:44:20.682210 10588 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 3003862655eb4c83b3428df3b9292bd2, State: Running, Role: LEADER
I20260808 08:44:20.682838 10588 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:20.683612 10579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:44:20.685979 10590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3003862655eb4c83b3428df3b9292bd2. Latest consensus state: current_term: 1 leader_uuid: "3003862655eb4c83b3428df3b9292bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } } }
I20260808 08:44:20.686007 10589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3003862655eb4c83b3428df3b9292bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } } }
I20260808 08:44:20.686558 10589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:44:20.686560 10590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:44:20.689038 10595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:44:20.696439 10595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:44:20.707248 10595 catalog_manager.cc:1347] Generated new cluster ID: 30ee66acb9324bb9b634fb04f9f6a0db
I20260808 08:44:20.707389 10595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:44:20.740038 10595 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:44:20.741699 10595 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:44:20.749312 10595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Generated new TSK 0
I20260808 08:44:20.750535 10595 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:44:20.839630 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36319
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:44:21.234931 10617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:21.235272 10617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:21.235375 10617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:21.243156 10617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:21.243302 10617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:21.243422 10617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:44:21.253756 10617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:21.255285 10617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:21.256695 10617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:21.271282 10625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:21.271296 10630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:21.271345 10627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:21.277758 10617 server_base.cc:1034] running on GCE node
I20260808 08:44:21.278679 10617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:21.279914 10617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:21.281245 10617 hybrid_clock.cc:648] HybridClock initialized: now 1786178661281169 us; error 60 us; skew 500 ppm
I20260808 08:44:21.281669 10617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:21 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:21.285632 10617 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:44:21.287559 10617 webserver.cc:460] Webserver started at http://127.19.242.193:42109/ using document root <none> and password file <none>
I20260808 08:44:21.288398 10617 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:21.288560 10617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:21.288959 10617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:44:21.293289 10617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "912e6588437c4061a5bcc444c163ac34"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "0f1f0a3991168ac527e01cf048675f77"
server_key_iv: "1d3dd0c714631c64968080e2cb7bb727"
server_key_version: "encryptionkey@0"
I20260808 08:44:21.294565 10617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "912e6588437c4061a5bcc444c163ac34"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "0f1f0a3991168ac527e01cf048675f77"
server_key_iv: "1d3dd0c714631c64968080e2cb7bb727"
server_key_version: "encryptionkey@0"
I20260808 08:44:21.303511 10617 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260808 08:44:21.307607 10639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:21.309257 10617 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:44:21.309487 10617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "912e6588437c4061a5bcc444c163ac34"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "0f1f0a3991168ac527e01cf048675f77"
server_key_iv: "1d3dd0c714631c64968080e2cb7bb727"
server_key_version: "encryptionkey@0"
I20260808 08:44:21.309762 10617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:21.328454 10617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:21.333701 10617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:21.334087 10617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:21.335355 10617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:21.336947 10617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:21.337031 10617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:21.337226 10617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:21.337306 10617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:21.375558 10617 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:37229
I20260808 08:44:21.375600 10803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:37229 every 8 connection(s)
I20260808 08:44:21.377023 10617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:44:21.383270 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 10617
I20260808 08:44:21.383546 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:44:21.384307 20427 external_mini_cluster.cc:1428] Setting key 25352013bb3ca0ef0dca36da624d755d
Aug 08 08:44:21 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:44:21.402657 10806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:21.379891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:45975 (local address 127.19.242.254:36319)
0808 08:44:21.380384 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:21.380389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:21.381544 (+ 1155us) server_negotiation.cc:407] Connection header received
0808 08:44:21.383825 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:21.383832 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:21.383934 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:21.384067 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:21.386301 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.387388 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.389149 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.389970 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.390120 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:21.394669 (+ 4549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:21.394679 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:21.394686 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:21.394761 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:21.398749 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:21.399775 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:21.399783 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:21.399789 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:21.399972 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:21.400454 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:21.400462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:21.400467 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:21.400888 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:21.401058 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:21.402166 (+ 1108us) server_negotiation.cc:299] Negotiation successful
0808 08:44:21.402371 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":255,"threads_started":1}
I20260808 08:44:21.404394 10807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:21.380503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:45975)
0808 08:44:21.381327 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:21.381382 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:21.383412 (+ 2030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:21.384387 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:21.384397 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:21.385175 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:21.386058 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:21.386085 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.387588 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.387592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:21.388967 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:21.388981 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.390306 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.390315 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:21.390568 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:21.391444 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:21.391480 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:21.394321 (+ 2841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:21.399003 (+ 4682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:21.399013 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:21.399065 (+ 52us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:21.399612 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:21.400107 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:21.400111 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:21.400113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:21.400332 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:21.401041 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:21.401049 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:21.401642 (+ 593us) client_negotiation.cc:769] Sending connection context
0808 08:44:21.402037 (+ 395us) client_negotiation.cc:240] Negotiation successful
0808 08:44:21.402781 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":308,"threads_started":1}
I20260808 08:44:21.406344 10804 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36319
I20260808 08:44:21.406785 10804 heartbeater.cc:464] Registering TS with master...
I20260808 08:44:21.407637 10804 heartbeater.cc:511] Master 127.19.242.254:36319 requested a full tablet report, sending...
I20260808 08:44:21.410405 10528 ts_manager.cc:194] Registered new tserver with Master: 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229)
I20260808 08:44:21.412052 10528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:45975
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:44:21.460343 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36319
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:44:21.835959 10811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:21.836345 10811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:21.836668 10811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:21.844717 10811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:21.844901 10811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:21.845098 10811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:44:21.855825 10811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:21.857293 10811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:21.858785 10811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:21.875000 10824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:21.875123 10820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:21.875031 10821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:21.876051 10811 server_base.cc:1034] running on GCE node
I20260808 08:44:21.876708 10811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:21.877775 10811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:21.879000 10811 hybrid_clock.cc:648] HybridClock initialized: now 1786178661878952 us; error 40 us; skew 500 ppm
I20260808 08:44:21.879374 10811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:21 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:21.882938 10811 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:44:21.884846 10811 webserver.cc:460] Webserver started at http://127.19.242.194:36025/ using document root <none> and password file <none>
I20260808 08:44:21.885636 10811 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:21.885790 10811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:21.886164 10811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:44:21.889590 10811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "a2f4734633254c86a9446e23245201ba"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "c51f7fe8a64dc4b84e523abc935d1f51"
server_key_iv: "cc1c7d7c0a60611238008d80aaf14f04"
server_key_version: "encryptionkey@0"
I20260808 08:44:21.890509 10811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "a2f4734633254c86a9446e23245201ba"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "c51f7fe8a64dc4b84e523abc935d1f51"
server_key_iv: "cc1c7d7c0a60611238008d80aaf14f04"
server_key_version: "encryptionkey@0"
I20260808 08:44:21.896792 10811 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:44:21.900727 10836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:21.902359 10811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:44:21.902576 10811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "a2f4734633254c86a9446e23245201ba"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "c51f7fe8a64dc4b84e523abc935d1f51"
server_key_iv: "cc1c7d7c0a60611238008d80aaf14f04"
server_key_version: "encryptionkey@0"
I20260808 08:44:21.902887 10811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:21.915413 10811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:21.920414 10811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:21.920706 10811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:21.921729 10811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:21.923310 10811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:21.923394 10811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:21.923489 10811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:21.923534 10811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:21.960615 10811 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:41235
I20260808 08:44:21.960639 10994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:41235 every 8 connection(s)
I20260808 08:44:21.962029 10811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:44:21.965471 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 10811
I20260808 08:44:21.965674 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:44:21.966367 20427 external_mini_cluster.cc:1428] Setting key ef3555c28c67ee9264781096b977357b
Aug 08 08:44:21 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:44:21.988279 10997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:21.964876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:43939 (local address 127.19.242.254:36319)
0808 08:44:21.965480 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:21.965487 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:21.966773 (+ 1286us) server_negotiation.cc:407] Connection header received
0808 08:44:21.969145 (+ 2372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:21.969149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:21.969217 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:21.969319 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:21.971804 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.972580 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.975258 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.975747 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.975858 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:21.980604 (+ 4746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:21.980610 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:21.980613 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:21.980653 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:21.984166 (+ 3513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:21.985429 (+ 1263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:21.985434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:21.985436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:21.985612 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:21.986290 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:21.986294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:21.986297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:21.986608 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:21.986875 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:21.987814 (+ 939us) server_negotiation.cc:299] Negotiation successful
0808 08:44:21.988008 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":312,"threads_started":1}
I20260808 08:44:21.989995 10999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:21.965533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:43939)
0808 08:44:21.966520 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:21.966616 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:21.968770 (+ 2154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:21.969657 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:21.969672 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:21.970545 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:21.971550 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:21.971583 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.972765 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.972773 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:21.975056 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:21.975077 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:21.976012 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:21.976023 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:21.976398 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:21.977254 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:21.977292 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:21.980277 (+ 2985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:21.984393 (+ 4116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:21.984407 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:21.984430 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:21.985235 (+ 805us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:21.985747 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:21.985754 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:21.985761 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:21.986125 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:21.986785 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:21.986798 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:21.987378 (+ 580us) client_negotiation.cc:769] Sending connection context
0808 08:44:21.987705 (+ 327us) client_negotiation.cc:240] Negotiation successful
0808 08:44:21.988343 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":373,"threads_started":1}
I20260808 08:44:21.991801 10995 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36319
I20260808 08:44:21.992225 10995 heartbeater.cc:464] Registering TS with master...
I20260808 08:44:21.993237 10995 heartbeater.cc:511] Master 127.19.242.254:36319 requested a full tablet report, sending...
I20260808 08:44:21.995343 10528 ts_manager.cc:194] Registered new tserver with Master: a2f4734633254c86a9446e23245201ba (127.19.242.194:41235)
I20260808 08:44:21.996526 10528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:43939
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:44:22.046166 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36319
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:44:22.415871 10804 heartbeater.cc:503] Master 127.19.242.254:36319 was elected leader, sending a full tablet report...
W20260808 08:44:22.440518 11006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:22.440845 11006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:22.441020 11006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:22.448596 11006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:22.448731 11006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:22.448941 11006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:44:22.459265 11006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:22.460701 11006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:22.462118 11006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:22.476969 11016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:22.477056 11018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:22.477341 11013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:22.478081 11006 server_base.cc:1034] running on GCE node
I20260808 08:44:22.478876 11006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:22.480063 11006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:22.481338 11006 hybrid_clock.cc:648] HybridClock initialized: now 1786178662481274 us; error 58 us; skew 500 ppm
I20260808 08:44:22.481709 11006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:22 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178662, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:22.485458 11006 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:44:22.487329 11006 webserver.cc:460] Webserver started at http://127.19.242.195:34533/ using document root <none> and password file <none>
I20260808 08:44:22.488143 11006 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:22.488320 11006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:22.488659 11006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:44:22.492143 11006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5"
format_stamp: "Formatted at 2026-08-08 08:44:22 on dist-test-slave-39l8"
server_key: "9c690ff785c4fe06989843befd448ec6"
server_key_iv: "2a3890eaae150623587215b56fd19a2d"
server_key_version: "encryptionkey@0"
I20260808 08:44:22.493021 11006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5"
format_stamp: "Formatted at 2026-08-08 08:44:22 on dist-test-slave-39l8"
server_key: "9c690ff785c4fe06989843befd448ec6"
server_key_iv: "2a3890eaae150623587215b56fd19a2d"
server_key_version: "encryptionkey@0"
I20260808 08:44:22.499409 11006 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:44:22.503547 11033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:22.505177 11006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:44:22.505398 11006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5"
format_stamp: "Formatted at 2026-08-08 08:44:22 on dist-test-slave-39l8"
server_key: "9c690ff785c4fe06989843befd448ec6"
server_key_iv: "2a3890eaae150623587215b56fd19a2d"
server_key_version: "encryptionkey@0"
I20260808 08:44:22.505651 11006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:22.522603 11006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:22.527552 11006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:22.527894 11006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:22.528986 11006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:22.530511 11006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:22.530622 11006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:22.530807 11006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:22.530891 11006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:22.567369 11006 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:41225
I20260808 08:44:22.567425 11196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:41225 every 8 connection(s)
I20260808 08:44:22.568886 11006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:44:22.571260 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 11006
I20260808 08:44:22.571477 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:44:22.572034 20427 external_mini_cluster.cc:1428] Setting key b64325ddafeed42cb2b26994d76ea4ec
Aug 08 08:44:22 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178662, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:44:22.592172 11202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.572047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:40607 (local address 127.19.242.254:36319)
0808 08:44:22.572600 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.572608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.573772 (+ 1164us) server_negotiation.cc:407] Connection header received
0808 08:44:22.575816 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.575820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.575891 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.575988 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:22.577797 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.578606 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.580409 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.580817 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.580921 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.585065 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:22.585071 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:22.585075 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:22.585122 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:22.588811 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:22.589719 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:22.589744 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:22.589746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:22.589884 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:22.590353 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:22.590357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:22.590359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:22.590763 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:22.590901 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.591658 (+ 757us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.591870 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":275,"threads_started":1}
I20260808 08:44:22.593319 11204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.572664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:40607)
0808 08:44:22.573590 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:22.573646 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:22.575531 (+ 1885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:22.576382 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:22.576392 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:22.576961 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:22.577601 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.577622 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.578890 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.578895 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.580260 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.580275 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.581034 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.581039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.581298 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.582104 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:22.582131 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:22.584823 (+ 2692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:22.588964 (+ 4141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:22.588972 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:22.588988 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:22.589594 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:22.590000 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:22.590004 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:22.590006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:22.590233 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:22.590886 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:22.590893 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:22.591274 (+ 381us) client_negotiation.cc:769] Sending connection context
0808 08:44:22.591546 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 08:44:22.592032 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":394,"threads_started":1}
I20260808 08:44:22.595101 11197 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36319
I20260808 08:44:22.595487 11197 heartbeater.cc:464] Registering TS with master...
I20260808 08:44:22.596371 11197 heartbeater.cc:511] Master 127.19.242.254:36319 requested a full tablet report, sending...
I20260808 08:44:22.598019 10528 ts_manager.cc:194] Registered new tserver with Master: 67ee2f5099d34c5cbbef7bfaea6b2dc5 (127.19.242.195:41225)
I20260808 08:44:22.599068 10528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:40607
I20260808 08:44:22.601262 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:44:22.621068 11202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.606217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33882 (local address 127.19.242.254:36319)
0808 08:44:22.606543 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.606555 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.607090 (+ 535us) server_negotiation.cc:407] Connection header received
0808 08:44:22.607296 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.607300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.607387 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.607483 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:22.609485 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.610399 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.611975 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.612398 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.612508 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.615353 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:22.615358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:22.615361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:22.615402 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:22.618178 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:22.619031 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:22.619035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:22.619037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:22.619172 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:22.619581 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:22.619585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:22.619587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:22.619932 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:22.620130 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.620519 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.620710 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260808 08:44:22.625998 10523 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:44:22.633590 10523 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:44:22.673626 11220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.650048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57988 (local address 127.19.242.193:37229)
0808 08:44:22.662630 (+ 12582us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.662645 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.663253 (+ 608us) server_negotiation.cc:407] Connection header received
0808 08:44:22.663376 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.663384 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.663686 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.663950 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:22.665687 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.667352 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.670751 (+ 3399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.672118 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.672275 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.672410 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.673051 (+ 641us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.673267 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12347,"thread_start_us":12161,"threads_started":1}
I20260808 08:44:22.673851 11222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.663470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.19.242.195:41225)
0808 08:44:22.666022 (+ 2552us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.666030 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.666066 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:44:22.666195 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.666204 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.666477 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.666726 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:22.667353 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.668634 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.671129 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.672676 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.672887 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.673060 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.673291 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.673471 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2346,"thread_start_us":2599,"threads_started":1}
I20260808 08:44:22.673913 11221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.663375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:41225 (local address 127.0.0.1:42950)
0808 08:44:22.665304 (+ 1929us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:22.665331 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:22.665474 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:22.666746 (+ 1272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:22.666752 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:22.666782 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:22.667152 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.667163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.668794 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.668800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.670917 (+ 2117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.670936 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.672897 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.672906 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.673083 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.673115 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 08:44:22.673215 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 08:44:22.673445 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1740,"mutex_wait_us":7,"thread_start_us":1519,"threads_started":1}
I20260808 08:44:22.674821 11217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.649353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45556 (local address 127.19.242.194:41235)
0808 08:44:22.663183 (+ 13830us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.663194 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.663233 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:44:22.663357 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.663369 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.663671 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.663954 (+ 283us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:22.665803 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.667323 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.671575 (+ 4252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.673233 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.673422 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.673577 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.674256 (+ 679us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.674462 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13632,"thread_start_us":13520,"threads_started":1}
I20260808 08:44:22.674865 11219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.648582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:41235 (local address 127.0.0.1:45556)
0808 08:44:22.660726 (+ 12144us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:22.660809 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:22.661028 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:22.664362 (+ 3334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:22.664375 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:22.664448 (+ 73us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:22.665542 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.665555 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.667462 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.667471 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.671362 (+ 3891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.671377 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.673754 (+ 2377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.673762 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.673998 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.674049 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 08:44:22.674164 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:44:22.674326 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11791,"mutex_wait_us":119,"spinlock_wait_cycles":5376,"thread_start_us":13960,"threads_started":1}
I20260808 08:44:22.675093 11215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.649477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:57988)
0808 08:44:22.662881 (+ 13404us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:22.662905 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:22.663074 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:22.664365 (+ 1291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:22.664377 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:22.664479 (+ 102us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:22.665409 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.665432 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.667524 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.667533 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.670487 (+ 2954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.670503 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.672563 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.672569 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.672719 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.672798 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 08:44:22.674421 (+ 1623us) client_negotiation.cc:240] Negotiation successful
0808 08:44:22.674571 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13249,"mutex_wait_us":98,"spinlock_wait_cycles":56576,"thread_start_us":11778,"threads_started":1}
I20260808 08:44:22.678923 10904 tablet_service.cc:1467] Processing CreateTablet for tablet 94df45e02f0a4aeeb6984b9d8792ce51 (DEFAULT_TABLE table=test-table [id=092146c8987745c6801606caecf6164d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:44:22.678761 11093 tablet_service.cc:1467] Processing CreateTablet for tablet 94df45e02f0a4aeeb6984b9d8792ce51 (DEFAULT_TABLE table=test-table [id=092146c8987745c6801606caecf6164d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:44:22.678815 10709 tablet_service.cc:1467] Processing CreateTablet for tablet 94df45e02f0a4aeeb6984b9d8792ce51 (DEFAULT_TABLE table=test-table [id=092146c8987745c6801606caecf6164d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:44:22.680266 10904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94df45e02f0a4aeeb6984b9d8792ce51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:22.680382 11093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94df45e02f0a4aeeb6984b9d8792ce51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:22.680382 10709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94df45e02f0a4aeeb6984b9d8792ce51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:22.695288 11223 tablet_bootstrap.cc:492] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Bootstrap starting.
I20260808 08:44:22.698468 11223 tablet_bootstrap.cc:654] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:22.699479 11224 tablet_bootstrap.cc:492] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Bootstrap starting.
I20260808 08:44:22.700064 11223 log.cc:824] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:22.700492 11225 tablet_bootstrap.cc:492] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Bootstrap starting.
I20260808 08:44:22.704365 11225 tablet_bootstrap.cc:654] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:22.704458 11224 tablet_bootstrap.cc:654] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:22.704702 11223 tablet_bootstrap.cc:492] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: No bootstrap required, opened a new log
I20260808 08:44:22.705092 11223 ts_tablet_manager.cc:1397] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 08:44:22.705862 11224 log.cc:824] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:22.705940 11225 log.cc:824] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:22.709139 11224 tablet_bootstrap.cc:492] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: No bootstrap required, opened a new log
I20260808 08:44:22.709512 11224 ts_tablet_manager.cc:1397] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 08:44:22.711916 11225 tablet_bootstrap.cc:492] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: No bootstrap required, opened a new log
I20260808 08:44:22.712252 11225 ts_tablet_manager.cc:1397] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260808 08:44:22.714673 11223 raft_consensus.cc:348] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.715175 11223 raft_consensus.cc:374] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:22.715324 11223 raft_consensus.cc:729] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2f4734633254c86a9446e23245201ba, State: Initialized, Role: FOLLOWER
I20260808 08:44:22.716049 11223 consensus_queue.cc:260] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.717317 10995 heartbeater.cc:503] Master 127.19.242.254:36319 was elected leader, sending a full tablet report...
I20260808 08:44:22.718152 11223 ts_tablet_manager.cc:1428] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260808 08:44:22.720772 11224 raft_consensus.cc:348] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.721284 11224 raft_consensus.cc:374] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:22.721390 11224 raft_consensus.cc:729] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 912e6588437c4061a5bcc444c163ac34, State: Initialized, Role: FOLLOWER
I20260808 08:44:22.722064 11224 consensus_queue.cc:260] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.724170 11224 ts_tablet_manager.cc:1428] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Time spent starting tablet: real 0.015s user 0.010s sys 0.003s
I20260808 08:44:22.724545 11225 raft_consensus.cc:348] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.725083 11225 raft_consensus.cc:374] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:22.725194 11225 raft_consensus.cc:729] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67ee2f5099d34c5cbbef7bfaea6b2dc5, State: Initialized, Role: FOLLOWER
I20260808 08:44:22.725797 11225 consensus_queue.cc:260] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.727005 11197 heartbeater.cc:503] Master 127.19.242.254:36319 was elected leader, sending a full tablet report...
I20260808 08:44:22.727816 11225 ts_tablet_manager.cc:1428] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
W20260808 08:44:22.820912 11199 tablet.cc:2369] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:44:22.820990 11230 raft_consensus.cc:482] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:22.821516 11230 raft_consensus.cc:504] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.823341 11230 leader_election.cc:288] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67ee2f5099d34c5cbbef7bfaea6b2dc5 (127.19.242.195:41225), 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229)
I20260808 08:44:22.831149 11222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.823814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:39761 (local address 127.19.242.195:41225)
0808 08:44:22.824034 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.824041 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.825117 (+ 1076us) server_negotiation.cc:407] Connection header received
0808 08:44:22.825346 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.825350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.825412 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.825516 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:22.826228 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.827066 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.829220 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.830031 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.830238 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.830333 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.830686 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.830845 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:44:22.831140 11220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.823861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:50339 (local address 127.19.242.193:37229)
0808 08:44:22.824090 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.824098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.825050 (+ 952us) server_negotiation.cc:407] Connection header received
0808 08:44:22.825299 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.825303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.825368 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.825472 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:22.826233 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.827054 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.829236 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.830057 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.830273 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.830356 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.830729 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.830864 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:44:22.831327 11234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.823896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.19.242.194:50339)
0808 08:44:22.824909 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:22.824928 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:22.825126 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:22.825494 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:22.825498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:22.825532 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:22.826000 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.826010 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.827210 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.827216 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.829058 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.829074 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.830337 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.830343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.830531 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.830555 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:44:22.830671 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:44:22.830830 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":837,"mutex_wait_us":90,"thread_start_us":537,"threads_started":1}
I20260808 08:44:22.831387 11238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.823963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:41225 (local address 127.19.242.194:39761)
0808 08:44:22.824976 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:22.824996 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:22.825184 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:22.825546 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:22.825550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:22.825576 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:22.826052 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.826062 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.827217 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.827222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.829041 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:22.829056 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.830303 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.830309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:22.830510 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.830537 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:44:22.830653 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:44:22.830823 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"mutex_wait_us":52,"thread_start_us":582,"threads_started":1}
I20260808 08:44:22.832612 11124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94df45e02f0a4aeeb6984b9d8792ce51" candidate_uuid: "a2f4734633254c86a9446e23245201ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" is_pre_election: true
I20260808 08:44:22.832612 10737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94df45e02f0a4aeeb6984b9d8792ce51" candidate_uuid: "a2f4734633254c86a9446e23245201ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "912e6588437c4061a5bcc444c163ac34" is_pre_election: true
I20260808 08:44:22.833151 11124 raft_consensus.cc:2454] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2f4734633254c86a9446e23245201ba in term 0.
I20260808 08:44:22.833153 10737 raft_consensus.cc:2454] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2f4734633254c86a9446e23245201ba in term 0.
I20260808 08:44:22.833899 10838 leader_election.cc:302] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67ee2f5099d34c5cbbef7bfaea6b2dc5, a2f4734633254c86a9446e23245201ba; no voters:
I20260808 08:44:22.834369 11230 raft_consensus.cc:2781] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:44:22.834532 11230 raft_consensus.cc:482] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:44:22.834645 11230 raft_consensus.cc:3037] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:22.837123 11230 raft_consensus.cc:504] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.837848 11230 leader_election.cc:288] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [CANDIDATE]: Term 1 election: Requested vote from peers 67ee2f5099d34c5cbbef7bfaea6b2dc5 (127.19.242.195:41225), 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229)
I20260808 08:44:22.838439 11124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94df45e02f0a4aeeb6984b9d8792ce51" candidate_uuid: "a2f4734633254c86a9446e23245201ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5"
I20260808 08:44:22.838526 10737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94df45e02f0a4aeeb6984b9d8792ce51" candidate_uuid: "a2f4734633254c86a9446e23245201ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "912e6588437c4061a5bcc444c163ac34"
I20260808 08:44:22.838753 11124 raft_consensus.cc:3037] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:22.838773 10737 raft_consensus.cc:3037] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:22.842317 11124 raft_consensus.cc:2454] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2f4734633254c86a9446e23245201ba in term 1.
I20260808 08:44:22.842315 10737 raft_consensus.cc:2454] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2f4734633254c86a9446e23245201ba in term 1.
I20260808 08:44:22.843076 10838 leader_election.cc:302] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67ee2f5099d34c5cbbef7bfaea6b2dc5, a2f4734633254c86a9446e23245201ba; no voters:
I20260808 08:44:22.843592 11230 raft_consensus.cc:2781] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:44:22.844154 11230 raft_consensus.cc:686] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 1 LEADER]: Becoming Leader. State: Replica: a2f4734633254c86a9446e23245201ba, State: Running, Role: LEADER
I20260808 08:44:22.844724 11230 consensus_queue.cc:237] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:22.850051 10523 catalog_manager.cc:5495] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba reported cstate change: term changed from 0 to 1, leader changed from <none> to a2f4734633254c86a9446e23245201ba (127.19.242.194). New cstate: current_term: 1 leader_uuid: "a2f4734633254c86a9446e23245201ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } health_report { overall_health: UNKNOWN } } }
W20260808 08:44:22.879925 10805 tablet.cc:2369] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:44:22.908948 11217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.902888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45570 (local address 127.19.242.194:41235)
0808 08:44:22.903109 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.903113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.903134 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:44:22.903341 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.903345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.903437 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.903611 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:44:22.904087 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.904981 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.906527 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.907080 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.907193 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.907741 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:44:22.908296 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:44:22.908421 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.908514 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.908595 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:44:22.918624 11124 raft_consensus.cc:1261] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 FOLLOWER]: Refusing update from remote peer a2f4734633254c86a9446e23245201ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:44:22.918628 10737 raft_consensus.cc:1261] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Refusing update from remote peer a2f4734633254c86a9446e23245201ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:44:22.919854 11239 consensus_queue.cc:1035] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:44:22.920387 11230 consensus_queue.cc:1035] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:44:22.934006 11243 mvcc.cc:205] Tried to move back new op lower bound from 7316187803303514112 to 7316187803016220672. Current Snapshot: MvccSnapshot[applied={T|T < 7316187803303514112}]
I20260808 08:44:22.952149 10523 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:44:22.952597 10523 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:44:22.956635 10523 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Sending DeleteTablet for 3 replicas of tablet 94df45e02f0a4aeeb6984b9d8792ce51
I20260808 08:44:22.958137 10904 tablet_service.cc:1514] Processing DeleteTablet for tablet 94df45e02f0a4aeeb6984b9d8792ce51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:22 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:45556
I20260808 08:44:22.958202 11093 tablet_service.cc:1514] Processing DeleteTablet for tablet 94df45e02f0a4aeeb6984b9d8792ce51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:22 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:42950
I20260808 08:44:22.958186 10709 tablet_service.cc:1514] Processing DeleteTablet for tablet 94df45e02f0a4aeeb6984b9d8792ce51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:22 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:57988
I20260808 08:44:22.958775 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 10617
I20260808 08:44:22.971602 11257 tablet_replica.cc:330] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: stopping tablet replica
I20260808 08:44:22.972525 11260 tablet_replica.cc:330] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: stopping tablet replica
I20260808 08:44:22.973205 11260 raft_consensus.cc:2229] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:44:22.973869 11257 raft_consensus.cc:2229] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:44:22.974602 11260 raft_consensus.cc:2258] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:22.975433 11257 raft_consensus.cc:2258] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:22.978380 11260 ts_tablet_manager.cc:1905] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:22.980819 11257 ts_tablet_manager.cc:1905] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:22.981608 11259 tablet_replica.cc:330] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: stopping tablet replica
I20260808 08:44:22.982220 11259 raft_consensus.cc:2229] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 08 08:44:22 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:44:22.985440 11259 raft_consensus.cc:2258] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:22.988155 11259 ts_tablet_manager.cc:1905] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:22.997437 11220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:22.959795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57996 (local address 127.19.242.193:37229)
0808 08:44:22.959984 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:22.959990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:22.970312 (+ 10322us) server_negotiation.cc:407] Connection header received
0808 08:44:22.970580 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:22.970587 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:22.970692 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:22.970817 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:22.973356 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.974565 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.977627 (+ 3062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:22.978662 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:22.978837 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:22.986470 (+ 7633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:22.986494 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:22.986517 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:22.986591 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:22.991251 (+ 4660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:22.992621 (+ 1370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:22.992633 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:22.992637 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:22.992855 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:22.994401 (+ 1546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:22.994408 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:22.994412 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:22.995530 (+ 1118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:22.995877 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:22.996678 (+ 801us) server_negotiation.cc:299] Negotiation successful
0808 08:44:22.996971 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:44:23.001998 11260 ts_tablet_manager.cc:1918] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:44:23.002367 11260 log.cc:1196] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/94df45e02f0a4aeeb6984b9d8792ce51
I20260808 08:44:23.003136 11260 ts_tablet_manager.cc:1939] T 94df45e02f0a4aeeb6984b9d8792ce51 P 912e6588437c4061a5bcc444c163ac34: Deleting consensus metadata
I20260808 08:44:23.004168 10795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:23.004944 11259 ts_tablet_manager.cc:1918] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:44:23.005204 11259 log.cc:1196] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/94df45e02f0a4aeeb6984b9d8792ce51
I20260808 08:44:23.005941 11259 ts_tablet_manager.cc:1939] T 94df45e02f0a4aeeb6984b9d8792ce51 P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Deleting consensus metadata
I20260808 08:44:23.006980 11257 ts_tablet_manager.cc:1918] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:44:23.007248 11257 log.cc:1196] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/94df45e02f0a4aeeb6984b9d8792ce51
I20260808 08:44:23.007939 11257 ts_tablet_manager.cc:1939] T 94df45e02f0a4aeeb6984b9d8792ce51 P a2f4734633254c86a9446e23245201ba: Deleting consensus metadata
I20260808 08:44:23.008946 10500 catalog_manager.cc:4841] TS 67ee2f5099d34c5cbbef7bfaea6b2dc5 (127.19.242.195:41225): tablet 94df45e02f0a4aeeb6984b9d8792ce51 (table test-table [id=092146c8987745c6801606caecf6164d]) successfully deleted
I20260808 08:44:23.011081 10500 catalog_manager.cc:4841] TS a2f4734633254c86a9446e23245201ba (127.19.242.194:41235): tablet 94df45e02f0a4aeeb6984b9d8792ce51 (table test-table [id=092146c8987745c6801606caecf6164d]) successfully deleted
I20260808 08:44:23.104244 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 10617
I20260808 08:44:23.104527 10501 catalog_manager.cc:4841] TS 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229): tablet 94df45e02f0a4aeeb6984b9d8792ce51 (table test-table [id=092146c8987745c6801606caecf6164d]) successfully deleted
I20260808 08:44:23.139554 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 10811
Aug 08 08:44:23 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:44:23.164340 11217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:23.140515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45578 (local address 127.19.242.194:41235)
0808 08:44:23.140767 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:23.140774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:23.140801 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:44:23.140904 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:23.140911 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:23.141011 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:23.141167 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:23.142638 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:23.144377 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:23.145892 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:23.146755 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:23.146923 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:23.157152 (+ 10229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:23.157173 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:23.157200 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:23.157257 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:23.160875 (+ 3618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:23.161959 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:23.161967 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:23.161970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:23.162143 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:23.162594 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:23.162598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:23.162600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:23.163102 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:23.163368 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:23.163820 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 08:44:23.164013 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260808 08:44:23.165202 10989 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:23.282850 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 10811
I20260808 08:44:23.309954 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 11006
Aug 08 08:44:23 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:44:23.328449 11222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:23.310844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42962 (local address 127.19.242.195:41225)
0808 08:44:23.311056 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:23.311061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:23.311129 (+ 68us) server_negotiation.cc:407] Connection header received
0808 08:44:23.311220 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:23.311224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:23.311297 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:23.311412 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:23.312789 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:23.313693 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:23.315165 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:23.315594 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:23.315711 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:23.321438 (+ 5727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:23.321457 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:23.321475 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:23.321521 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:23.324982 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:23.325956 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:23.325966 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:23.325968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:23.326242 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:23.326629 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:23.326632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:23.326635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:23.327225 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:23.327476 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:23.327886 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 08:44:23.328135 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:44:23.329175 11186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:23.423652 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 11006
I20260808 08:44:23.448447 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 10469
I20260808 08:44:23.449911 10574 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:23.565303 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 10469
I20260808 08:44:43.597977 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36319
--webserver_interface=127.19.242.254
--webserver_port=33935
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:44:43.963855 11270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:43.964334 11270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:43.964497 11270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:43.973032 11270 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:44:43.973167 11270 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:44:43.973234 11270 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:44:43.973313 11270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:44:43.973415 11270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:43.973531 11270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:43.973620 11270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:44:43.973707 11270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:44:43.984827 11270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=33935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:43.986311 11270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:43.987871 11270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:44.022807 11280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:44.023752 11279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:44.023783 11284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:44.024024 11270 server_base.cc:1034] running on GCE node
I20260808 08:44:44.025348 11270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:44.027347 11270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:44.028676 11270 hybrid_clock.cc:648] HybridClock initialized: now 1786178684028580 us; error 48 us; skew 500 ppm
I20260808 08:44:44.029243 11270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:44 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:44.033561 11270 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:44:44.035547 11270 webserver.cc:460] Webserver started at http://127.19.242.254:33935/ using document root <none> and password file <none>
I20260808 08:44:44.036468 11270 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:44.036628 11270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:44.043591 11270 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:44:44.047127 11295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:44.048769 11270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:44:44.049019 11270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "3003862655eb4c83b3428df3b9292bd2"
format_stamp: "Formatted at 2026-08-08 08:44:20 on dist-test-slave-39l8"
server_key: "7c0a94f6e5e2b758621db209bdb93362"
server_key_iv: "5c682b9401e9fc17bb410e2f4c8101e4"
server_key_version: "encryptionkey@0"
I20260808 08:44:44.050252 11270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:44.064183 11270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:44.069448 11270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:44.069821 11270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:44.092188 11270 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36319
I20260808 08:44:44.092288 11370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36319 every 8 connection(s)
I20260808 08:44:44.094183 11270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:44:44.102466 11371 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:44:44.103765 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 11270
I20260808 08:44:44.104743 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:37229
--local_ip_for_outbound_sockets=127.19.242.193
--tserver_master_addrs=127.19.242.254:36319
--webserver_port=42109
--webserver_interface=127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:44:44.106457 11371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Bootstrap starting.
I20260808 08:44:44.128947 11371 log.cc:824] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:44.143623 11371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:44:44.144255 11371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Bootstrap complete.
I20260808 08:44:44.154062 11371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:44.155341 11371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3003862655eb4c83b3428df3b9292bd2, State: Initialized, Role: FOLLOWER
I20260808 08:44:44.156172 11371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:44.156476 11371 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:44:44.156616 11371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:44:44.156822 11371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:44:44.161796 11371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:44.162510 11371 leader_election.cc:302] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3003862655eb4c83b3428df3b9292bd2; no voters:
I20260808 08:44:44.163278 11371 leader_election.cc:288] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:44:44.163442 11376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:44:44.166095 11371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:44:44.170640 11376 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 LEADER]: Becoming Leader. State: Replica: 3003862655eb4c83b3428df3b9292bd2, State: Running, Role: LEADER
I20260808 08:44:44.171468 11376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:44:44.174695 11377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3003862655eb4c83b3428df3b9292bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } } }
I20260808 08:44:44.175248 11377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:44:44.174789 11380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3003862655eb4c83b3428df3b9292bd2. Latest consensus state: current_term: 2 leader_uuid: "3003862655eb4c83b3428df3b9292bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } } }
I20260808 08:44:44.175979 11380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:44:44.182479 11394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:44:44.192152 11394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:44:44.193789 11394 catalog_manager.cc:1259] Loaded cluster ID: 30ee66acb9324bb9b634fb04f9f6a0db
I20260808 08:44:44.193933 11394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:44:44.198410 11394 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:44:44.200351 11394 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Loaded TSK: 0
I20260808 08:44:44.231812 11394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Generated new TSK 1
I20260808 08:44:44.232275 11394 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:44:44.503160 11373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:44.503484 11373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:44.503641 11373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:44.511416 11373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:44.511550 11373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:44.511734 11373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:44:44.522393 11373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:37229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=42109
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:44.523866 11373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:44.525323 11373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:44.539642 11417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:44.539872 11415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:44.540643 11419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:44.541313 11373 server_base.cc:1034] running on GCE node
I20260808 08:44:44.542069 11373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:44.543329 11373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:44.544569 11373 hybrid_clock.cc:648] HybridClock initialized: now 1786178684544500 us; error 68 us; skew 500 ppm
I20260808 08:44:44.544952 11373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:44 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:44.548892 11373 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:44:44.550849 11373 webserver.cc:460] Webserver started at http://127.19.242.193:42109/ using document root <none> and password file <none>
I20260808 08:44:44.551669 11373 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:44.551857 11373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:44.558058 11373 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 08:44:44.561304 11435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:44.562986 11373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:44:44.563192 11373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "912e6588437c4061a5bcc444c163ac34"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "0f1f0a3991168ac527e01cf048675f77"
server_key_iv: "1d3dd0c714631c64968080e2cb7bb727"
server_key_version: "encryptionkey@0"
I20260808 08:44:44.564239 11373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:44.585076 11373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:44.589685 11373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:44.589985 11373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:44.591061 11373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:44.592530 11373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:44.592634 11373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:44.592772 11373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:44.592868 11373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:44.629598 11373 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:37229
I20260808 08:44:44.629726 11615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:37229 every 8 connection(s)
I20260808 08:44:44.631234 11373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:44:44.641062 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 11373
I20260808 08:44:44.641808 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:41235
--local_ip_for_outbound_sockets=127.19.242.194
--tserver_master_addrs=127.19.242.254:36319
--webserver_port=36025
--webserver_interface=127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:44:44 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178684, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:44:44.660183 11622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:44.634745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:40953)
0808 08:44:44.635752 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:44.635803 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:44.637691 (+ 1888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:44.639375 (+ 1684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:44.639388 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:44.640116 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:44.640942 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:44.640974 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:44.643106 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:44.643116 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:44.645437 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:44.645465 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:44.646754 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:44.646767 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:44.647136 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:44.648000 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:44.648051 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:44.651109 (+ 3058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:44.655184 (+ 4075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:44.655204 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:44.655245 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:44.655844 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:44.656347 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:44.656352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:44.656356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:44.656566 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:44.657419 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:44.657428 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:44.657791 (+ 363us) client_negotiation.cc:769] Sending connection context
0808 08:44:44.658094 (+ 303us) client_negotiation.cc:240] Negotiation successful
0808 08:44:44.658755 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":399,"threads_started":1}
I20260808 08:44:44.660194 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:44.634468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:40953 (local address 127.19.242.254:36319)
0808 08:44:44.635469 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:44.635488 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:44.635970 (+ 482us) server_negotiation.cc:407] Connection header received
0808 08:44:44.638304 (+ 2334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:44.638317 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:44.638686 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:44.639181 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:44.641321 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:44.642865 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:44.645669 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:44.646425 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:44.646594 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:44.651496 (+ 4902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:44.651506 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:44.651524 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:44.651577 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:44.654989 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:44.656015 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:44.656022 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:44.656028 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:44.656204 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:44.656715 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:44.656726 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:44.656729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:44.657255 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:44.657468 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:44.658316 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 08:44:44.658782 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":462,"threads_started":1}
I20260808 08:44:44.663341 11616 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36319
I20260808 08:44:44.663803 11616 heartbeater.cc:464] Registering TS with master...
I20260808 08:44:44.664784 11616 heartbeater.cc:511] Master 127.19.242.254:36319 requested a full tablet report, sending...
I20260808 08:44:44.667546 11320 ts_manager.cc:194] Registered new tserver with Master: 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229)
I20260808 08:44:44.669409 11320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:40953
W20260808 08:44:45.016593 11623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:45.016942 11623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:45.017138 11623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:45.024791 11623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:45.024936 11623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:45.025125 11623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:44:45.035728 11623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:41235
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=36025
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:45.037385 11623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:45.038942 11623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:45.054023 11632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:45.054090 11629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:45.053998 11630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:45.054957 11623 server_base.cc:1034] running on GCE node
I20260808 08:44:45.055791 11623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:45.056901 11623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:45.058152 11623 hybrid_clock.cc:648] HybridClock initialized: now 1786178685058107 us; error 47 us; skew 500 ppm
I20260808 08:44:45.058513 11623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:45 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178685, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:45.062165 11623 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:44:45.063846 11623 webserver.cc:460] Webserver started at http://127.19.242.194:36025/ using document root <none> and password file <none>
I20260808 08:44:45.064626 11623 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:45.064814 11623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:45.071447 11623 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:44:45.074693 11645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:45.076493 11623 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:44:45.076746 11623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "a2f4734633254c86a9446e23245201ba"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "c51f7fe8a64dc4b84e523abc935d1f51"
server_key_iv: "cc1c7d7c0a60611238008d80aaf14f04"
server_key_version: "encryptionkey@0"
I20260808 08:44:45.077962 11623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:45.092933 11623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:45.098219 11623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:45.098558 11623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:45.099929 11623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:45.101536 11623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:45.101681 11623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:45.101812 11623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:45.101902 11623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:45.139576 11623 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:41235
I20260808 08:44:45.139680 11800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:41235 every 8 connection(s)
I20260808 08:44:45.141187 11623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:44:45.150101 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 11623
I20260808 08:44:45.151010 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:41225
--local_ip_for_outbound_sockets=127.19.242.195
--tserver_master_addrs=127.19.242.254:36319
--webserver_port=34533
--webserver_interface=127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:44:45 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178685, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:44:45.167585 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.144135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:55647 (local address 127.19.242.254:36319)
0808 08:44:45.144389 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.144396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.145615 (+ 1219us) server_negotiation.cc:407] Connection header received
0808 08:44:45.147675 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.147681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.147785 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.147917 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:45.149831 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.151135 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.153094 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.153948 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.154137 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.158776 (+ 4639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:45.158787 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:45.158796 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:45.158854 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:45.163201 (+ 4347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.164170 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.164180 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.164187 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.164373 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.165327 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.165331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.165334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.165675 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:45.165815 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.167022 (+ 1207us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.167247 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:44:45.169519 11805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.144575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:55647)
0808 08:44:45.145414 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:45.145466 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:45.147323 (+ 1857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:45.148253 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:45.148262 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:45.148843 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:45.149495 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.149517 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.151434 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.151439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.152888 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.152904 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.154242 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.154249 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.154600 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.155529 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:45.155557 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:45.158403 (+ 2846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:45.163445 (+ 5042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:45.163455 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:45.163472 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:45.164007 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:45.164559 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:45.164583 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:45.164587 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:45.165006 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:45.165855 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:45.165869 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:45.166472 (+ 603us) client_negotiation.cc:769] Sending connection context
0808 08:44:45.166906 (+ 434us) client_negotiation.cc:240] Negotiation successful
0808 08:44:45.167637 (+ 731us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":369,"threads_started":1}
I20260808 08:44:45.171602 11801 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36319
I20260808 08:44:45.171980 11801 heartbeater.cc:464] Registering TS with master...
I20260808 08:44:45.172819 11801 heartbeater.cc:511] Master 127.19.242.254:36319 requested a full tablet report, sending...
I20260808 08:44:45.174568 11320 ts_manager.cc:194] Registered new tserver with Master: a2f4734633254c86a9446e23245201ba (127.19.242.194:41235)
I20260808 08:44:45.175508 11320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:55647
W20260808 08:44:45.529270 11807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:44:45.529683 11807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:44:45.529874 11807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:44:45.537570 11807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:44:45.537788 11807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:44:45.537997 11807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:44:45.548529 11807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:41225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=34533
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:44:45.550048 11807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:44:45.551590 11807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:44:45.566819 11815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:45.567088 11816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:44:45.567358 11819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:44:45.568447 11807 server_base.cc:1034] running on GCE node
I20260808 08:44:45.569314 11807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:44:45.570384 11807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:44:45.571594 11807 hybrid_clock.cc:648] HybridClock initialized: now 1786178685571515 us; error 72 us; skew 500 ppm
I20260808 08:44:45.571957 11807 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:44:45 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178685, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:44:45.575484 11807 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:44:45.577220 11807 webserver.cc:460] Webserver started at http://127.19.242.195:34533/ using document root <none> and password file <none>
I20260808 08:44:45.577945 11807 fs_manager.cc:359] Metadata directory not provided
I20260808 08:44:45.578073 11807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:44:45.584487 11807 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:44:45.587713 11833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:45.589363 11807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:44:45.589609 11807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5"
format_stamp: "Formatted at 2026-08-08 08:44:22 on dist-test-slave-39l8"
server_key: "9c690ff785c4fe06989843befd448ec6"
server_key_iv: "2a3890eaae150623587215b56fd19a2d"
server_key_version: "encryptionkey@0"
I20260808 08:44:45.590749 11807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:44:45.611689 11807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:44:45.617084 11807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:44:45.617667 11807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:44:45.619045 11807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:44:45.621031 11807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:44:45.621191 11807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:45.621351 11807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:44:45.621446 11807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:44:45.660488 11807 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:41225
I20260808 08:44:45.660553 12001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:41225 every 8 connection(s)
I20260808 08:44:45.662073 11807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:44:45.671638 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 11807
I20260808 08:44:45.673048 11616 heartbeater.cc:503] Master 127.19.242.254:36319 was elected leader, sending a full tablet report...
Aug 08 08:44:45 dist-test-slave-39l8 krb5kdc[10445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178685, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:44:45.687832 11618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.664901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:36811 (local address 127.19.242.254:36319)
0808 08:44:45.665133 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.665137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.666495 (+ 1358us) server_negotiation.cc:407] Connection header received
0808 08:44:45.668652 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.668657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.668771 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.668880 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:45.670566 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.671347 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.673756 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.674391 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.674502 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.679345 (+ 4843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:45.679352 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:45.679358 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:45.679403 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:45.683610 (+ 4207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.684785 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.684789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.684792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.684929 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.685578 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.685582 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.685584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.685863 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:45.685982 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.687107 (+ 1125us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.687386 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:44:45.689024 12007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.665425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:36811)
0808 08:44:45.666325 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:45.666366 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:45.668352 (+ 1986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:45.669169 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:45.669178 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:45.669735 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:44:45.670394 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.670412 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.671544 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.671550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.673574 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.673593 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.674970 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.674979 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.675346 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.676182 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:44:45.676223 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:44:45.679084 (+ 2861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:44:45.683794 (+ 4710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:45.683807 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:45.683835 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:45.684643 (+ 808us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:45.685067 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:44:45.685073 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:44:45.685076 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:44:45.685448 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:44:45.686017 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:44:45.686027 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:44:45.686599 (+ 572us) client_negotiation.cc:769] Sending connection context
0808 08:44:45.687014 (+ 415us) client_negotiation.cc:240] Negotiation successful
0808 08:44:45.687519 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":314,"threads_started":1}
I20260808 08:44:45.690754 12002 heartbeater.cc:347] Connected to a master server at 127.19.242.254:36319
I20260808 08:44:45.691143 12002 heartbeater.cc:464] Registering TS with master...
I20260808 08:44:45.692168 12002 heartbeater.cc:511] Master 127.19.242.254:36319 requested a full tablet report, sending...
I20260808 08:44:45.694198 11320 ts_manager.cc:194] Registered new tserver with Master: 67ee2f5099d34c5cbbef7bfaea6b2dc5 (127.19.242.195:41225)
I20260808 08:44:45.694247 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.672752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45146 (local address 127.19.242.254:36319)
0808 08:44:45.676694 (+ 3942us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.676698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.676712 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:44:45.676754 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.676757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.676809 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.676894 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:45.678917 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.680075 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.682358 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.683170 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.683317 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.687281 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:45.687289 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:45.687297 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:45.687338 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:45.690880 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.691764 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.691772 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.691776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.691944 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.692491 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.692496 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.692499 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.692907 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:45.693183 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.693593 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.693826 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3848,"thread_start_us":3087,"threads_started":1}
I20260808 08:44:45.695621 11320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:36811
I20260808 08:44:45.697329 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:44:45.705209 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.698535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45158 (local address 127.19.242.254:36319)
0808 08:44:45.698810 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.698820 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.699341 (+ 521us) server_negotiation.cc:407] Connection header received
0808 08:44:45.699546 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.699550 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.699698 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.699828 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:44:45.700348 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.701141 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.703177 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.703724 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.703830 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.704351 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:44:45.704569 (+ 218us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 08:44:45.704890 (+ 321us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45158: token expired
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 08:44:45.705376 12009 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45158: token expired
W20260808 08:44:45.706055 11205 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.242.254:36319)
I20260808 08:44:45.720708 12009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.706777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45162 (local address 127.19.242.254:36319)
0808 08:44:45.706972 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.706976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.706992 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:44:45.707087 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.707090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.707149 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.707239 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:45.708661 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.709471 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.711183 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.711616 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.711729 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.714575 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:45.714582 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:45.714587 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:45.714629 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:45.717616 (+ 2987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.718379 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.718383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.718386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.718531 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:45.718993 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:45.718998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:45.719001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:45.719460 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:45.719706 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.720010 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.720264 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:44:45.724762 11320 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45162:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:44:45.732538 11320 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:44:45.765714 12024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.747946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41696 (local address 127.19.242.193:37229)
0808 08:44:45.757329 (+ 9383us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.757344 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.757389 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:44:45.757525 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.757538 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.757839 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.758082 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:45.758980 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.760679 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.763016 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.764297 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.764524 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.764731 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.765155 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.765365 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9032,"thread_start_us":8891,"threads_started":1}
I20260808 08:44:45.766589 12017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.746996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41696)
0808 08:44:45.756415 (+ 9419us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:45.756435 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:45.756548 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:45.758115 (+ 1567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:45.758133 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:45.758172 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:45.758743 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.758765 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.760865 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.760871 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.762674 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.762688 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.764591 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.764598 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.764838 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.764908 (+ 70us) client_negotiation.cc:769] Sending connection context
0808 08:44:45.765945 (+ 1037us) client_negotiation.cc:240] Negotiation successful
0808 08:44:45.766183 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9220,"thread_start_us":8178,"threads_started":1}
I20260808 08:44:45.768608 12026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.757893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:41235 (local address 127.0.0.1:52966)
0808 08:44:45.758922 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:45.758942 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:45.759083 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:45.760426 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:45.760431 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:45.760458 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:45.761287 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.761300 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.763203 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.763208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.765395 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.765410 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.767737 (+ 2327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.767746 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.767935 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.767968 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:44:45.768060 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:44:45.768207 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"mutex_wait_us":303,"thread_start_us":691,"threads_started":1}
I20260808 08:44:45.768639 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.746363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47318 (local address 127.19.242.195:41225)
0808 08:44:45.757600 (+ 11237us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.757612 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.757651 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:44:45.757768 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.757777 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.758016 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.758241 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:45.761062 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.762681 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.765854 (+ 3173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.767380 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.767649 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.767843 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.768084 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.768280 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11022,"thread_start_us":10855,"threads_started":1}
I20260808 08:44:45.768983 12025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.756937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52966 (local address 127.19.242.194:41235)
0808 08:44:45.757832 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.757840 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.759073 (+ 1233us) server_negotiation.cc:407] Connection header received
0808 08:44:45.759559 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.759569 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.760059 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.760704 (+ 645us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:45.761499 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.763047 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.765588 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.767391 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.768162 (+ 771us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.768345 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.768414 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.768670 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":628,"threads_started":1}
I20260808 08:44:45.769960 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.745999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:41225 (local address 127.0.0.1:47318)
0808 08:44:45.755720 (+ 9721us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:45.755778 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:45.755994 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:45.760380 (+ 4386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:45.760388 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:45.760421 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:45.760848 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.760863 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.762848 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.762853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.765658 (+ 2805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.765676 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.767676 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.767683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.767867 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.767909 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:44:45.769515 (+ 1606us) client_negotiation.cc:240] Negotiation successful
0808 08:44:45.769687 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9424,"mutex_wait_us":562,"thread_start_us":10215,"threads_started":1}
I20260808 08:44:45.773034 11719 tablet_service.cc:1467] Processing CreateTablet for tablet 7da5ae810210418c9c6776394f182c7f (DEFAULT_TABLE table=test-table [id=df7240f636a14c95b14fa0b85735c4bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:44:45.773980 11911 tablet_service.cc:1467] Processing CreateTablet for tablet 7da5ae810210418c9c6776394f182c7f (DEFAULT_TABLE table=test-table [id=df7240f636a14c95b14fa0b85735c4bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:44:45.774163 11510 tablet_service.cc:1467] Processing CreateTablet for tablet 7da5ae810210418c9c6776394f182c7f (DEFAULT_TABLE table=test-table [id=df7240f636a14c95b14fa0b85735c4bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:44:45.774744 11719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7da5ae810210418c9c6776394f182c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:45.775503 11911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7da5ae810210418c9c6776394f182c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:45.775501 11510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7da5ae810210418c9c6776394f182c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:44:45.790304 12029 tablet_bootstrap.cc:492] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Bootstrap starting.
I20260808 08:44:45.792100 12032 tablet_bootstrap.cc:492] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Bootstrap starting.
I20260808 08:44:45.795028 12029 tablet_bootstrap.cc:654] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:45.795920 12032 tablet_bootstrap.cc:654] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:45.796537 12029 log.cc:824] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:45.797295 12032 log.cc:824] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:45.801177 12029 tablet_bootstrap.cc:492] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: No bootstrap required, opened a new log
I20260808 08:44:45.801581 12029 ts_tablet_manager.cc:1397] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260808 08:44:45.801949 12033 tablet_bootstrap.cc:492] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Bootstrap starting.
I20260808 08:44:45.805477 12033 tablet_bootstrap.cc:654] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Neither blocks nor log segments found. Creating new log.
I20260808 08:44:45.805979 12032 tablet_bootstrap.cc:492] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: No bootstrap required, opened a new log
I20260808 08:44:45.806308 12032 ts_tablet_manager.cc:1397] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260808 08:44:45.806766 12033 log.cc:824] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:44:45.809517 12033 tablet_bootstrap.cc:492] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: No bootstrap required, opened a new log
I20260808 08:44:45.809834 12033 ts_tablet_manager.cc:1397] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260808 08:44:45.812814 12029 raft_consensus.cc:348] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.813369 12029 raft_consensus.cc:374] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:45.813478 12029 raft_consensus.cc:729] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 912e6588437c4061a5bcc444c163ac34, State: Initialized, Role: FOLLOWER
I20260808 08:44:45.814281 12029 consensus_queue.cc:260] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.816556 12029 ts_tablet_manager.cc:1428] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Time spent starting tablet: real 0.015s user 0.008s sys 0.007s
I20260808 08:44:45.817456 12032 raft_consensus.cc:348] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.817898 12032 raft_consensus.cc:374] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:45.818027 12032 raft_consensus.cc:729] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2f4734633254c86a9446e23245201ba, State: Initialized, Role: FOLLOWER
I20260808 08:44:45.818684 12032 consensus_queue.cc:260] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.819995 11801 heartbeater.cc:503] Master 127.19.242.254:36319 was elected leader, sending a full tablet report...
I20260808 08:44:45.819849 12033 raft_consensus.cc:348] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.820340 12033 raft_consensus.cc:374] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:44:45.820466 12033 raft_consensus.cc:729] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67ee2f5099d34c5cbbef7bfaea6b2dc5, State: Initialized, Role: FOLLOWER
I20260808 08:44:45.821138 12033 consensus_queue.cc:260] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.822206 12032 ts_tablet_manager.cc:1428] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260808 08:44:45.823403 12002 heartbeater.cc:503] Master 127.19.242.254:36319 was elected leader, sending a full tablet report...
I20260808 08:44:45.824096 12033 ts_tablet_manager.cc:1428] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Time spent starting tablet: real 0.014s user 0.007s sys 0.007s
I20260808 08:44:45.878587 12039 raft_consensus.cc:482] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:44:45.879022 12039 raft_consensus.cc:504] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.880892 12039 leader_election.cc:288] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2f4734633254c86a9446e23245201ba (127.19.242.194:41235), 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229)
W20260808 08:44:45.883963 11617 tablet.cc:2369] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:44:45.888073 12024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.881456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:43455 (local address 127.19.242.193:37229)
0808 08:44:45.881680 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.881687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.881888 (+ 201us) server_negotiation.cc:407] Connection header received
0808 08:44:45.882118 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.882123 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.882240 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.882372 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:45.882925 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.884005 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.885940 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.887195 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.887332 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.887391 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.887782 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.887881 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:44:45.888242 12007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.881538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.19.242.195:43455)
0808 08:44:45.881778 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:45.881800 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:45.881940 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:45.882403 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:45.882408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:45.882440 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:45.882741 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.882761 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.884155 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.884159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.885748 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.885762 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.887379 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.887387 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.887595 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.887632 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:44:45.887748 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:44:45.887904 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:44:45.889233 12025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.881456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:52551 (local address 127.19.242.194:41235)
0808 08:44:45.881680 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.881687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.883036 (+ 1349us) server_negotiation.cc:407] Connection header received
0808 08:44:45.883142 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.883147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.883256 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.883378 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:44:45.884060 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.884854 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.887060 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.888276 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.888450 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.888538 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.888897 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.889023 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:44:45.889432 12043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.881536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:41235 (local address 127.19.242.195:52551)
0808 08:44:45.882903 (+ 1367us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:45.882926 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:44:45.883042 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:44:45.883433 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:44:45.883436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:44:45.883457 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:44:45.883869 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.883885 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.885003 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.885009 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.886847 (+ 1838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:44:45.886864 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.888591 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.888596 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:44:45.888722 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.888747 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:44:45.888862 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:44:45.889021 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1201,"mutex_wait_us":483,"thread_start_us":465,"threads_started":1}
I20260808 08:44:45.889413 11544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7da5ae810210418c9c6776394f182c7f" candidate_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "912e6588437c4061a5bcc444c163ac34" is_pre_election: true
I20260808 08:44:45.890045 11544 raft_consensus.cc:2454] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67ee2f5099d34c5cbbef7bfaea6b2dc5 in term 0.
I20260808 08:44:45.890491 11743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7da5ae810210418c9c6776394f182c7f" candidate_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2f4734633254c86a9446e23245201ba" is_pre_election: true
I20260808 08:44:45.890929 11839 leader_election.cc:302] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67ee2f5099d34c5cbbef7bfaea6b2dc5, 912e6588437c4061a5bcc444c163ac34; no voters:
I20260808 08:44:45.891079 11743 raft_consensus.cc:2454] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67ee2f5099d34c5cbbef7bfaea6b2dc5 in term 0.
I20260808 08:44:45.891392 12039 raft_consensus.cc:2781] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:44:45.891559 12039 raft_consensus.cc:482] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:44:45.891696 12039 raft_consensus.cc:3037] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 0 FOLLOWER]: Advancing to term 1
W20260808 08:44:45.893359 11803 tablet.cc:2369] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:44:45.894119 12039 raft_consensus.cc:504] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.894855 12039 leader_election.cc:288] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [CANDIDATE]: Term 1 election: Requested vote from peers a2f4734633254c86a9446e23245201ba (127.19.242.194:41235), 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229)
I20260808 08:44:45.895536 11544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7da5ae810210418c9c6776394f182c7f" candidate_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "912e6588437c4061a5bcc444c163ac34"
I20260808 08:44:45.895534 11743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7da5ae810210418c9c6776394f182c7f" candidate_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2f4734633254c86a9446e23245201ba"
I20260808 08:44:45.895788 11743 raft_consensus.cc:3037] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:45.895769 11544 raft_consensus.cc:3037] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:44:45.899166 11743 raft_consensus.cc:2454] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67ee2f5099d34c5cbbef7bfaea6b2dc5 in term 1.
I20260808 08:44:45.899161 11544 raft_consensus.cc:2454] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67ee2f5099d34c5cbbef7bfaea6b2dc5 in term 1.
I20260808 08:44:45.899750 11839 leader_election.cc:302] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67ee2f5099d34c5cbbef7bfaea6b2dc5, 912e6588437c4061a5bcc444c163ac34; no voters:
I20260808 08:44:45.900139 12039 raft_consensus.cc:2781] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:44:45.900686 12039 raft_consensus.cc:686] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 67ee2f5099d34c5cbbef7bfaea6b2dc5, State: Running, Role: LEADER
I20260808 08:44:45.901180 12039 consensus_queue.cc:237] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } }
I20260808 08:44:45.906297 11320 catalog_manager.cc:5495] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67ee2f5099d34c5cbbef7bfaea6b2dc5 (127.19.242.195). New cstate: current_term: 1 leader_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 41225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 } health_report { overall_health: UNKNOWN } } }
W20260808 08:44:45.914062 12005 tablet.cc:2369] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:44:45.956424 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:45.949916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47328 (local address 127.19.242.195:41225)
0808 08:44:45.950247 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:45.950251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:45.950272 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:44:45.950374 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:45.950378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:45.950457 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:45.950616 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:44:45.951158 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.951921 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.953706 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:45.954247 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:45.954359 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:45.955089 (+ 730us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:44:45.955748 (+ 659us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:44:45.955878 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:45.956003 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 08:44:45.956082 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260808 08:44:45.965782 11743 raft_consensus.cc:1261] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 1 FOLLOWER]: Refusing update from remote peer 67ee2f5099d34c5cbbef7bfaea6b2dc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:44:45.965778 11544 raft_consensus.cc:1261] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Refusing update from remote peer 67ee2f5099d34c5cbbef7bfaea6b2dc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:44:45.967061 12044 consensus_queue.cc:1035] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "912e6588437c4061a5bcc444c163ac34" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:44:45.967446 12039 consensus_queue.cc:1035] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2f4734633254c86a9446e23245201ba" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 41235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:44:45.987972 12051 mvcc.cc:205] Tried to move back new op lower bound from 7316187897704189952 to 7316187897455243264. Current Snapshot: MvccSnapshot[applied={T|T < 7316187897704189952 or (T in {7316187897704189952})}]
I20260808 08:44:46.002471 11319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:44:46.002921 11319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45162:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:44:46.007090 11319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Sending DeleteTablet for 3 replicas of tablet 7da5ae810210418c9c6776394f182c7f
I20260808 08:44:46.008709 11510 tablet_service.cc:1514] Processing DeleteTablet for tablet 7da5ae810210418c9c6776394f182c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:45 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:41696
I20260808 08:44:46.008726 11719 tablet_service.cc:1514] Processing DeleteTablet for tablet 7da5ae810210418c9c6776394f182c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:45 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:52966
I20260808 08:44:46.008750 11911 tablet_service.cc:1514] Processing DeleteTablet for tablet 7da5ae810210418c9c6776394f182c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:44:45 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:47318
I20260808 08:44:46.010278 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 11373
I20260808 08:44:46.021152 12063 tablet_replica.cc:330] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: stopping tablet replica
I20260808 08:44:46.022027 12064 tablet_replica.cc:330] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: stopping tablet replica
I20260808 08:44:46.022974 12063 raft_consensus.cc:2229] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:44:46.023689 12064 raft_consensus.cc:2229] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:44:46.024441 12064 raft_consensus.cc:2258] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:46.025204 12063 raft_consensus.cc:2258] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:46.028590 12063 ts_tablet_manager.cc:1905] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:46.028570 12064 ts_tablet_manager.cc:1905] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:46.034360 12024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.012090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41702 (local address 127.19.242.193:37229)
0808 08:44:46.012282 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:46.012290 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:46.012312 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:44:46.012386 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:46.012391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:46.012482 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:46.012609 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:46.014907 (+ 2298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:46.016147 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:46.018195 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:46.018917 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:46.019057 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:46.024255 (+ 5198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:46.024274 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:46.024295 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:46.024346 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:46.029163 (+ 4817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:46.030365 (+ 1202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:46.030375 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:46.030380 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:46.030616 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:46.031213 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:46.031218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:46.031222 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:46.031787 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:46.032134 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:46.033492 (+ 1358us) server_negotiation.cc:299] Negotiation successful
0808 08:44:46.033842 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:44:46.035390 11608 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:46.038292 12064 ts_tablet_manager.cc:1918] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:44:46.038669 12064 log.cc:1196] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/7da5ae810210418c9c6776394f182c7f
I20260808 08:44:46.039664 12064 ts_tablet_manager.cc:1939] T 7da5ae810210418c9c6776394f182c7f P a2f4734633254c86a9446e23245201ba: Deleting consensus metadata
I20260808 08:44:46.042625 11297 catalog_manager.cc:4841] TS a2f4734633254c86a9446e23245201ba (127.19.242.194:41235): tablet 7da5ae810210418c9c6776394f182c7f (table test-table [id=df7240f636a14c95b14fa0b85735c4bb]) successfully deleted
I20260808 08:44:46.043133 12068 tablet_replica.cc:330] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: stopping tablet replica
I20260808 08:44:46.043848 12068 raft_consensus.cc:2229] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:44:46.044818 12068 raft_consensus.cc:2258] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:44:46.047823 12068 ts_tablet_manager.cc:1905] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:44:46.057905 12068 ts_tablet_manager.cc:1918] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:44:46.058204 12068 log.cc:1196] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/7da5ae810210418c9c6776394f182c7f
I20260808 08:44:46.059038 12068 ts_tablet_manager.cc:1939] T 7da5ae810210418c9c6776394f182c7f P 67ee2f5099d34c5cbbef7bfaea6b2dc5: Deleting consensus metadata
I20260808 08:44:46.061658 11297 catalog_manager.cc:4841] TS 67ee2f5099d34c5cbbef7bfaea6b2dc5 (127.19.242.195:41225): tablet 7da5ae810210418c9c6776394f182c7f (table test-table [id=df7240f636a14c95b14fa0b85735c4bb]) successfully deleted
I20260808 08:44:46.145498 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 11373
W20260808 08:44:46.172254 11298 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.242.193:37229 (error 108)
I20260808 08:44:46.172472 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 11623
I20260808 08:44:46.174641 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.174111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41704)
0808 08:44:46.174315 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.174453 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260808 08:44:46.174965 11298 catalog_manager.cc:4584] TS 912e6588437c4061a5bcc444c163ac34 (127.19.242.193:37229): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7da5ae810210418c9c6776394f182c7f: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
I20260808 08:44:46.190205 12025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.173812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52982 (local address 127.19.242.194:41235)
0808 08:44:46.174018 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:46.174025 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:46.174044 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:44:46.174110 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:46.174115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:46.174211 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:46.174326 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:46.175953 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:46.176722 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:46.178126 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:46.178547 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:46.178706 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:46.181725 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:46.181741 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:46.181759 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:46.181810 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:46.185850 (+ 4040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:46.187105 (+ 1255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:46.187115 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:46.187117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:46.187275 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:46.187835 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:46.187840 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:46.187842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:46.188330 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:46.188678 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:46.189523 (+ 845us) server_negotiation.cc:299] Negotiation successful
0808 08:44:46.189750 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:44:46.191138 11795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:46.228840 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.228221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41716)
0808 08:44:46.228506 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.228632 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 08:44:46.230243 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.229765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41732)
0808 08:44:46.229961 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.230077 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 08:44:46.289479 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 11623
I20260808 08:44:46.300233 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.299548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41742)
0808 08:44:46.299909 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.300040 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260808 08:44:46.301680 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.301149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41756)
0808 08:44:46.301369 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.301487 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 08:44:46.320621 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 11807
I20260808 08:44:46.338649 12019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.321625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47330 (local address 127.19.242.195:41225)
0808 08:44:46.321859 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 08:44:46.321865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:44:46.321891 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:44:46.321973 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:44:46.321980 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:44:46.322079 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:44:46.322190 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:44:46.323724 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:46.325033 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:46.326517 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:44:46.327332 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:44:46.327474 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:44:46.330555 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:44:46.330573 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:44:46.330596 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:44:46.330652 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:44:46.335033 (+ 4381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:46.335954 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:46.335967 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:46.335971 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:46.336217 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:44:46.336699 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:44:46.336704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:44:46.336733 (+ 29us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:44:46.337257 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:44:46.337600 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0808 08:44:46.337926 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 08:44:46.338196 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:44:46.339677 11996 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:46.383005 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.382282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41764)
0808 08:44:46.382571 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.382677 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260808 08:44:46.384331 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.383864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41772)
0808 08:44:46.384084 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.384167 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260808 08:44:46.470239 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 11807
I20260808 08:44:46.499508 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 11270
I20260808 08:44:46.500723 11361 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:44:46.618539 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 11270
I20260808 08:44:46.618659 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:44:46.617979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37229 (local address 127.0.0.1:41776)
0808 08:44:46.618295 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 08:44:46.618442 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37229: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174}
I20260808 08:45:06.648685 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36319
--webserver_interface=127.19.242.254
--webserver_port=33935
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:36319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:07.018464 12080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:07.018889 12080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:07.019062 12080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:07.026626 12080 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:45:07.026840 12080 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:45:07.026921 12080 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:45:07.027015 12080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:07.027124 12080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:07.027244 12080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:07.027325 12080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:07.027408 12080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:07.038002 12080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:36319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:36319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=33935
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:07.039539 12080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:07.041006 12080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:07.055276 12090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:07.055301 12091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:07.056083 12093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:07.056384 12080 server_base.cc:1034] running on GCE node
I20260808 08:45:07.057305 12080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:07.059029 12080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:07.060343 12080 hybrid_clock.cc:648] HybridClock initialized: now 1786178707060271 us; error 47 us; skew 500 ppm
I20260808 08:45:07.060724 12080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:07 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178707, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:07.064518 12080 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:45:07.066274 12080 webserver.cc:460] Webserver started at http://127.19.242.254:33935/ using document root <none> and password file <none>
I20260808 08:45:07.067104 12080 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:07.067217 12080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:07.073539 12080 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:45:07.077252 12108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:07.079110 12080 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:07.079356 12080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "3003862655eb4c83b3428df3b9292bd2"
format_stamp: "Formatted at 2026-08-08 08:44:20 on dist-test-slave-39l8"
server_key: "7c0a94f6e5e2b758621db209bdb93362"
server_key_iv: "5c682b9401e9fc17bb410e2f4c8101e4"
server_key_version: "encryptionkey@0"
I20260808 08:45:07.080485 12080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:07.120498 12080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:07.125542 12080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:07.125897 12080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:07.146586 12080 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:36319
I20260808 08:45:07.146623 12180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:36319 every 8 connection(s)
I20260808 08:45:07.148320 12080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:07.154196 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 12080
I20260808 08:45:07.155409 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:37229
--local_ip_for_outbound_sockets=127.19.242.193
--tserver_master_addrs=127.19.242.254:36319
--webserver_port=42109
--webserver_interface=127.19.242.193
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:45:07.157538 12181 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:45:07.163455 12181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Bootstrap starting.
I20260808 08:45:07.187672 12181 log.cc:824] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:07.205902 12181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:45:07.206538 12181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Bootstrap complete.
I20260808 08:45:07.216203 12181 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:45:07.217200 12181 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3003862655eb4c83b3428df3b9292bd2, State: Initialized, Role: FOLLOWER
I20260808 08:45:07.217932 12181 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:45:07.218209 12181 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:07.218344 12181 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:07.218528 12181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:45:07.223042 12181 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:45:07.223663 12181 leader_election.cc:302] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3003862655eb4c83b3428df3b9292bd2; no voters:
I20260808 08:45:07.224409 12181 leader_election.cc:288] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:45:07.224604 12188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:45:07.225731 12188 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [term 3 LEADER]: Becoming Leader. State: Replica: 3003862655eb4c83b3428df3b9292bd2, State: Running, Role: LEADER
I20260808 08:45:07.226415 12188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } }
I20260808 08:45:07.227057 12181 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:07.229292 12191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3003862655eb4c83b3428df3b9292bd2. Latest consensus state: current_term: 3 leader_uuid: "3003862655eb4c83b3428df3b9292bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } } }
I20260808 08:45:07.229755 12191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:07.230381 12190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3003862655eb4c83b3428df3b9292bd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3003862655eb4c83b3428df3b9292bd2" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 36319 } } }
I20260808 08:45:07.230685 12190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:07.234995 12197 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:07.246451 12197 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:07.249305 12197 catalog_manager.cc:1259] Loaded cluster ID: 30ee66acb9324bb9b634fb04f9f6a0db
I20260808 08:45:07.249454 12197 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:07.255419 12197 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:07.257899 12197 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Loaded TSK: 0
I20260808 08:45:07.258347 12197 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3003862655eb4c83b3428df3b9292bd2: Loaded TSK: 1
F20260808 08:45:07.260123 12197 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9d57b449ad google::LogMessage::Fail() at ??:0
@ 0x7f9d57b4788a google::LogMessage::SendToLog() at ??:0
@ 0x7f9d57b444de google::LogMessage::Flush() at ??:0
@ 0x7f9d57b45a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9d5b8a87d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
I20260808 08:45:07.277189 12218 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f9d5b89773e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f9d6d5771c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f9d6d576783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f9d6d6022a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f9d6d6020c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f9d6d64c5e9 std::function<>::operator()() at ??:0
@ 0x7f9d6d57acdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f9d6d578c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9d6d600610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9d6d600439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9d5a790345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9d5a79391c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9d5a793799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9d5a76eeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9d5da486db start_thread at ??:0
@ 0x7f9d569de61f clone at ??:0
W20260808 08:45:07.600703 12186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:07.601080 12186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:07.601263 12186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:07.609207 12186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:07.609401 12186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:07.609586 12186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:45:07.620183 12186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:37229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=42109
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:07.621657 12186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:07.623073 12186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:07.638597 12262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:07.638695 12264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:07.639145 12186 server_base.cc:1034] running on GCE node
W20260808 08:45:07.639339 12259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:07.640164 12186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:07.641327 12186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:07.642645 12186 hybrid_clock.cc:648] HybridClock initialized: now 1786178707642570 us; error 58 us; skew 500 ppm
I20260808 08:45:07.643098 12186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:07 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178707, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:07.651036 12186 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:45:07.653129 12186 webserver.cc:460] Webserver started at http://127.19.242.193:42109/ using document root <none> and password file <none>
I20260808 08:45:07.653998 12186 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:07.654196 12186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:07.660974 12186 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:45:07.665047 12273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:07.667053 12186 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:07.667354 12186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "912e6588437c4061a5bcc444c163ac34"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "0f1f0a3991168ac527e01cf048675f77"
server_key_iv: "1d3dd0c714631c64968080e2cb7bb727"
server_key_version: "encryptionkey@0"
I20260808 08:45:07.668540 12186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:07.688647 12186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:07.693522 12186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:07.693941 12186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:07.695369 12186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:07.697371 12284 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 08:45:07.703341 12284 ts_tablet_manager.cc:1852] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 08:45:07.704461 12284 ts_tablet_manager.cc:1905] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:07.713189 12284 ts_tablet_manager.cc:1918] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:07.713460 12284 log.cc:1196] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/7da5ae810210418c9c6776394f182c7f
I20260808 08:45:07.714042 12284 ts_tablet_manager.cc:1939] T 7da5ae810210418c9c6776394f182c7f P 912e6588437c4061a5bcc444c163ac34: Deleting consensus metadata
I20260808 08:45:07.714581 12186 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 08:45:07.714778 12186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.018s user 0.001s sys 0.000s
I20260808 08:45:07.714932 12186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:07.715040 12186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:07.752926 12186 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:37229
I20260808 08:45:07.752977 12442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:37229 every 8 connection(s)
I20260808 08:45:07.754343 12186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:45:07.759759 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:07.757748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:55057)
0808 08:45:07.758554 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:07.758863 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":311,"threads_started":1}
W20260808 08:45:07.760447 12443 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:36319 (0 consecutive failures): Network error: Failed to ping master at 127.19.242.254:36319: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
I20260808 08:45:07.761397 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:07.761052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:43151)
0808 08:45:07.761206 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:07.761290 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 08:45:07.762300 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:07.761972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:48871)
0808 08:45:07.762097 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:07.762173 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 08:45:07.762596 12443 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:45:07.764988 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 12186
I20260808 08:45:07.765713 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:41235
--local_ip_for_outbound_sockets=127.19.242.194
--tserver_master_addrs=127.19.242.254:36319
--webserver_port=36025
--webserver_interface=127.19.242.194
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:08.138128 12447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:08.138453 12447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:08.138670 12447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:08.146529 12447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:08.146668 12447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:08.146878 12447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:45:08.157105 12447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:41235
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=36025
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:08.158558 12447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:08.160010 12447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:08.174494 12459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:08.174605 12457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:08.174642 12456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:08.175799 12447 server_base.cc:1034] running on GCE node
I20260808 08:45:08.176569 12447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:08.177805 12447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:08.179059 12447 hybrid_clock.cc:648] HybridClock initialized: now 1786178708179001 us; error 42 us; skew 500 ppm
I20260808 08:45:08.179495 12447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:08 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178708, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:08.183315 12447 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:45:08.185089 12447 webserver.cc:460] Webserver started at http://127.19.242.194:36025/ using document root <none> and password file <none>
I20260808 08:45:08.185874 12447 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:08.185997 12447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:08.192579 12447 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:45:08.195906 12471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:08.197492 12447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:45:08.197721 12447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "a2f4734633254c86a9446e23245201ba"
format_stamp: "Formatted at 2026-08-08 08:44:21 on dist-test-slave-39l8"
server_key: "c51f7fe8a64dc4b84e523abc935d1f51"
server_key_iv: "cc1c7d7c0a60611238008d80aaf14f04"
server_key_version: "encryptionkey@0"
I20260808 08:45:08.198915 12447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:08.227888 12447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:08.233220 12447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:08.233560 12447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:08.234839 12447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:08.236359 12447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:08.236485 12447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:08.236619 12447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:08.236704 12447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:08.273416 12447 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:41235
I20260808 08:45:08.273510 12645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:41235 every 8 connection(s)
I20260808 08:45:08.275130 12447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:45:08.280402 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:08.278383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:47567)
0808 08:45:08.279227 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:08.279476 (+ 249us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":349,"threads_started":1}
W20260808 08:45:08.281244 12646 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:36319 (0 consecutive failures): Network error: Failed to ping master at 127.19.242.254:36319: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
I20260808 08:45:08.281430 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 12447
I20260808 08:45:08.282104 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:41225
--local_ip_for_outbound_sockets=127.19.242.195
--tserver_master_addrs=127.19.242.254:36319
--webserver_port=34533
--webserver_interface=127.19.242.195
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:45:08.282239 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:08.281858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:39189)
0808 08:45:08.282020 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:08.282100 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:45:08.283318 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:08.282833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:54263)
0808 08:45:08.283020 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:08.283143 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:45:08.283589 12646 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:45:08.659838 12649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:08.660223 12649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:08.660394 12649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:08.668016 12649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:08.668219 12649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:08.668404 12649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:45:08.679339 12649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:41225
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=34533
--tserver_master_addrs=127.19.242.254:36319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:08.680843 12649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:08.682305 12649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:08.697084 12656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:08.697038 12658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:08.697136 12660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:08.698071 12649 server_base.cc:1034] running on GCE node
I20260808 08:45:08.698918 12649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:08.700155 12649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:08.701407 12649 hybrid_clock.cc:648] HybridClock initialized: now 1786178708701354 us; error 50 us; skew 500 ppm
I20260808 08:45:08.701786 12649 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:08 dist-test-slave-39l8 krb5kdc[10445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178708, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:08.705497 12649 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:45:08.707254 12649 webserver.cc:460] Webserver started at http://127.19.242.195:34533/ using document root <none> and password file <none>
I20260808 08:45:08.707994 12649 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:08.708119 12649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:08.714789 12649 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:45:08.718344 12668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:08.720274 12649 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 08:45:08.720536 12649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "67ee2f5099d34c5cbbef7bfaea6b2dc5"
format_stamp: "Formatted at 2026-08-08 08:44:22 on dist-test-slave-39l8"
server_key: "9c690ff785c4fe06989843befd448ec6"
server_key_iv: "2a3890eaae150623587215b56fd19a2d"
server_key_version: "encryptionkey@0"
I20260808 08:45:08.721716 12649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:08.739823 12649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:08.744901 12649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:08.745221 12649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:08.746410 12649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:08.748195 12649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:08.748392 12649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 08:45:08.748569 12649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:08.748685 12649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:08.764663 12739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:08.763482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:44305)
0808 08:45:08.764195 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:08.764355 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":380,"threads_started":1}
I20260808 08:45:08.786110 12649 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:41225
I20260808 08:45:08.786182 12839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:41225 every 8 connection(s)
I20260808 08:45:08.787804 12649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:45:08.793105 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:08.791062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:33265)
0808 08:45:08.791881 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:08.792134 (+ 253us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":302,"threads_started":1}
W20260808 08:45:08.793867 12840 heartbeater.cc:644] Failed to heartbeat to 127.19.242.254:36319 (0 consecutive failures): Network error: Failed to ping master at 127.19.242.254:36319: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
I20260808 08:45:08.794996 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:08.794510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:35839)
0808 08:45:08.794762 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:08.794866 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 08:45:08.796005 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:08.795627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:54071)
0808 08:45:08.795779 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:08.795876 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:45:08.796265 12840 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:45:08.797688 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 12649
I20260808 08:45:09.285203 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:09.284273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:42803)
0808 08:45:09.284823 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:09.284925 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":267,"threads_started":1}
I20260808 08:45:09.767091 12847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:09.766097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:48629)
0808 08:45:09.766680 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:09.766861 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":317,"threads_started":1}
I20260808 08:45:09.797937 12849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:09.797015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:52023)
0808 08:45:09.797558 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:09.797694 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":256,"threads_started":1}
I20260808 08:45:10.287272 12850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:10.286350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:40281)
0808 08:45:10.286959 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:10.287051 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":289,"threads_started":1}
I20260808 08:45:10.768926 12852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:10.768110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:41415)
0808 08:45:10.768628 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:10.768740 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":264,"threads_started":1}
I20260808 08:45:10.800011 12853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:10.799115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:59695)
0808 08:45:10.799729 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:10.799832 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":280,"threads_started":1}
I20260808 08:45:11.289323 12854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:11.288400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:59909)
0808 08:45:11.289023 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:11.289127 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":367,"threads_started":1}
I20260808 08:45:11.770953 12856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:11.770081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:43195)
0808 08:45:11.770591 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:11.770691 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":264,"threads_started":1}
I20260808 08:45:11.801895 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:11.801083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:57411)
0808 08:45:11.801604 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:11.801704 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":275,"threads_started":1}
I20260808 08:45:12.291432 12860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:12.290473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:40645)
0808 08:45:12.291086 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:12.291234 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":346,"threads_started":1}
I20260808 08:45:12.772993 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:12.772101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:46403)
0808 08:45:12.772668 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:12.772785 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":290,"threads_started":1}
I20260808 08:45:12.804430 12862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:12.803389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:53697)
0808 08:45:12.803939 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:12.804129 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":276,"threads_started":1}
I20260808 08:45:13.293684 12863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:13.292702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:36939)
0808 08:45:13.293387 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:13.293483 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":403,"threads_started":1}
I20260808 08:45:13.775012 12864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:13.774157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:44131)
0808 08:45:13.774672 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:13.774838 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":261,"threads_started":1}
I20260808 08:45:13.806528 12865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:13.805689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:53899)
0808 08:45:13.806249 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:13.806341 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":263,"threads_started":1}
I20260808 08:45:14.295719 12868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:14.294831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:39393)
0808 08:45:14.295422 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:14.295526 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":316,"threads_started":1}
I20260808 08:45:14.776963 12869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:14.776019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:49921)
0808 08:45:14.776602 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:14.776727 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":277,"threads_started":1}
I20260808 08:45:14.808706 12870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:14.807699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:46035)
0808 08:45:14.808333 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:14.808444 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":335,"threads_started":1}
I20260808 08:45:15.297916 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:15.296924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:48791)
0808 08:45:15.297571 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:15.297676 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":280,"threads_started":1}
I20260808 08:45:15.778985 12872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:15.778100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:58701)
0808 08:45:15.778616 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:15.778803 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":266,"threads_started":1}
I20260808 08:45:15.810894 12873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:15.809952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:52617)
0808 08:45:15.810509 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:15.810614 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":259,"threads_started":1}
I20260808 08:45:16.300050 12874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:16.299122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:43335)
0808 08:45:16.299752 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:16.299861 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":310,"threads_started":1}
I20260808 08:45:16.780895 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:16.780055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:33013)
0808 08:45:16.780590 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:16.780719 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":260,"threads_started":1}
I20260808 08:45:16.812835 12877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:16.811983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:48289)
0808 08:45:16.812550 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:16.812649 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":287,"threads_started":1}
I20260808 08:45:17.301963 12880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:17.301120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:38321)
0808 08:45:17.301679 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:17.301777 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":301,"threads_started":1}
I20260808 08:45:17.782902 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:17.782068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:36803)
0808 08:45:17.782604 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:17.782722 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":296,"threads_started":1}
I20260808 08:45:17.814853 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:17.813908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:42207)
0808 08:45:17.814500 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:17.814593 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":298,"threads_started":1}
I20260808 08:45:18.303942 12887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:18.302993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:35191)
0808 08:45:18.303650 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:18.303773 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":345,"threads_started":1}
I20260808 08:45:18.784977 12888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:18.784047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:35875)
0808 08:45:18.784652 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:18.784753 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":348,"threads_started":1}
I20260808 08:45:18.817008 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:18.816162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:58199)
0808 08:45:18.816694 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:18.816829 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":280,"threads_started":1}
I20260808 08:45:19.305955 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:19.305034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:55735)
0808 08:45:19.305623 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:19.305750 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":286,"threads_started":1}
I20260808 08:45:19.787209 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:19.786267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:42035)
0808 08:45:19.786879 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:19.786982 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":292,"threads_started":1}
I20260808 08:45:19.818986 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:19.818099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:33071)
0808 08:45:19.818593 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:19.818783 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":246,"threads_started":1}
I20260808 08:45:20.308079 12895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:20.307235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:46521)
0808 08:45:20.307806 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:20.307912 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":273,"threads_started":1}
I20260808 08:45:20.789283 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:20.788320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:43947)
0808 08:45:20.788895 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:20.789031 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":272,"threads_started":1}
I20260808 08:45:20.821327 12899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:20.820268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:48139)
0808 08:45:20.820891 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:20.821059 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":313,"threads_started":1}
I20260808 08:45:21.310075 12900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:21.309195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:37355)
0808 08:45:21.309734 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:21.309869 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":267,"threads_started":1}
I20260808 08:45:21.791348 12901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:21.790456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:60243)
0808 08:45:21.791064 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:21.791165 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":349,"threads_started":1}
I20260808 08:45:21.823757 12902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:21.822622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:50537)
0808 08:45:21.823415 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:21.823529 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":491,"threads_started":1}
I20260808 08:45:22.312243 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:22.311340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:49067)
0808 08:45:22.311876 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:22.311976 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":266,"threads_started":1}
I20260808 08:45:22.793581 12904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:22.792710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:48883)
0808 08:45:22.793272 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:22.793389 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":282,"threads_started":1}
I20260808 08:45:22.825736 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:22.824867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:34973)
0808 08:45:22.825428 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:22.825543 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":307,"threads_started":1}
I20260808 08:45:23.314641 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:23.313755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.194:55451)
0808 08:45:23.314253 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:23.314418 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":237,"threads_started":1}
I20260808 08:45:23.795600 12912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:23.794679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.193:43555)
0808 08:45:23.795340 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:23.795435 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":268,"threads_started":1}
I20260808 08:45:23.804757 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 12186
I20260808 08:45:23.827135 12913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:23.806074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59826 (local address 127.19.242.193:37229)
0808 08:45:23.806877 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:23.806899 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:23.806953 (+ 54us) server_negotiation.cc:407] Connection header received
0808 08:45:23.809127 (+ 2174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:23.809140 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:23.809648 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:23.810057 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:23.811862 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:23.813173 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:23.814793 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:23.815601 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:23.815797 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:23.818853 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:23.818866 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:23.818889 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:23.818952 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:23.822845 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:23.823870 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:23.823879 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:23.823889 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:23.824114 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:23.824564 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:23.824569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:23.824571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:23.825257 (+ 686us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:23.825555 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:23.826127 (+ 572us) server_negotiation.cc:299] Negotiation successful
0808 08:45:23.826814 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":335,"threads_started":1}
I20260808 08:45:23.827968 12915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:23.827134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:36319 (local address 127.19.242.195:42055)
0808 08:45:23.827693 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:23.827796 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.254:36319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":302,"threads_started":1}
I20260808 08:45:23.828860 12436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:23.919762 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 12186
I20260808 08:45:23.951472 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 12447
I20260808 08:45:23.971962 12919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:23.952736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35064 (local address 127.19.242.194:41235)
0808 08:45:23.953473 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:23.953488 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:23.953532 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:45:23.955345 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:23.955359 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:23.955834 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:23.956225 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:23.957804 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:23.959382 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:23.960826 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:23.961592 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:23.961763 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:23.964845 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:23.964854 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:23.964874 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:23.964925 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:23.968205 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:23.969029 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:23.969037 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:23.969045 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:23.969293 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:23.969733 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:23.969738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:23.969740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:23.970425 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:23.970783 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:23.971257 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 08:45:23.971658 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":354,"threads_started":1}
I20260808 08:45:23.973773 12639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:24.063222 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 12447
I20260808 08:45:24.089828 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 12649
I20260808 08:45:24.112259 12921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:24.091192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54432 (local address 127.19.242.195:41225)
0808 08:45:24.091931 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:24.091948 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:24.091998 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:45:24.094128 (+ 2130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:24.094149 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:24.094977 (+ 828us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:24.095350 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:24.097023 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:24.098450 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:24.100031 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:24.100863 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:24.101036 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:24.104523 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:24.104533 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:24.104560 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:24.104630 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:24.108184 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:24.109128 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:24.109138 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:24.109146 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:24.109375 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:24.109804 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:24.109808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:24.109810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:24.110453 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:24.110915 (+ 462us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:24.111352 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 08:45:24.111904 (+ 552us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":382,"threads_started":1}
I20260808 08:45:24.113945 12830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:24.203220 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 12649
2026-08-08T08:45:24Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65786 ms)
[----------] 30 tests from SecurityITest (326056 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:24 dist-test-slave-39l8 krb5kdc[12925](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:24 dist-test-slave-39l8 krb5kdc[12925](info): set up 2 sockets
Aug 08 08:45:24 dist-test-slave-39l8 krb5kdc[12925](info): commencing operation
krb5kdc: starting...
W20260808 08:45:25.557369 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.005s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:45:25 dist-test-slave-39l8 krb5kdc[12925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:45:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:45:25.906579 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35747
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:35747
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:26.309334 12942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:26.309705 12942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:26.309877 12942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:26.317667 12942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:26.317816 12942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:26.317906 12942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:26.318001 12942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:26.318079 12942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:26.329059 12942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:35747
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:26.330586 12942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:26.332072 12942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:26.346084 12952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:26.346098 12953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:26.346035 12959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:26.347667 12942 server_base.cc:1034] running on GCE node
I20260808 08:45:26.348639 12942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:26.350373 12942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:26.351657 12942 hybrid_clock.cc:648] HybridClock initialized: now 1786178726351594 us; error 61 us; skew 500 ppm
I20260808 08:45:26.352224 12942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:26 dist-test-slave-39l8 krb5kdc[12925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178726, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:26.356102 12942 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:45:26.358361 12942 webserver.cc:460] Webserver started at http://127.19.242.254:32859/ using document root <none> and password file <none>
I20260808 08:45:26.359333 12942 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:26.359524 12942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:26.359905 12942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:26.363782 12942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "85bfad35ac124c738669a577f2f22604"
format_stamp: "Formatted at 2026-08-08 08:45:26 on dist-test-slave-39l8"
server_key: "34da3df42a51292f28c29af838739320"
server_key_iv: "ef12f6e3db7cdebdf1352ba485ff6ce6"
server_key_version: "encryptionkey@0"
I20260808 08:45:26.364801 12942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "85bfad35ac124c738669a577f2f22604"
format_stamp: "Formatted at 2026-08-08 08:45:26 on dist-test-slave-39l8"
server_key: "34da3df42a51292f28c29af838739320"
server_key_iv: "ef12f6e3db7cdebdf1352ba485ff6ce6"
server_key_version: "encryptionkey@0"
I20260808 08:45:26.371610 12942 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:45:26.376201 12967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:26.377859 12942 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:45:26.378156 12942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "85bfad35ac124c738669a577f2f22604"
format_stamp: "Formatted at 2026-08-08 08:45:26 on dist-test-slave-39l8"
server_key: "34da3df42a51292f28c29af838739320"
server_key_iv: "ef12f6e3db7cdebdf1352ba485ff6ce6"
server_key_version: "encryptionkey@0"
I20260808 08:45:26.378440 12942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:26.415647 12942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:26.421854 12942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:26.422223 12942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:26.444135 13042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:35747 every 8 connection(s)
I20260808 08:45:26.444131 12942 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:35747
I20260808 08:45:26.445833 12942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:26.450637 13043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:26.454820 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 12942
I20260808 08:45:26.455116 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:26.455933 20427 external_mini_cluster.cc:1428] Setting key 1ef017de007b030502e8b0d21259b90a
I20260808 08:45:26.466007 13043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604: Bootstrap starting.
I20260808 08:45:26.470883 13043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:26.472456 13043 log.cc:824] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:26.476630 13043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604: No bootstrap required, opened a new log
Aug 08 08:45:26 dist-test-slave-39l8 krb5kdc[12925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:26.485898 13043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85bfad35ac124c738669a577f2f22604" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35747 } }
I20260808 08:45:26.486423 13043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:26.486583 13043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85bfad35ac124c738669a577f2f22604, State: Initialized, Role: FOLLOWER
I20260808 08:45:26.487378 13043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85bfad35ac124c738669a577f2f22604" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35747 } }
I20260808 08:45:26.487753 13043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:26.487957 13043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:26.488166 13043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:26.489113 13048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:26.458559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60126 (local address 127.19.242.254:35747)
0808 08:45:26.459616 (+ 1057us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:26.459630 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:26.459680 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:45:26.463490 (+ 3810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:26.463543 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:26.464306 (+ 763us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:26.464917 (+ 611us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:26.467948 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:26.470913 (+ 2965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:26.472949 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:26.474284 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:26.474555 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:26.479433 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:26.479442 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:26.479465 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:26.479513 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:26.483758 (+ 4245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:26.484843 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:26.484857 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:26.484865 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:26.485083 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:26.485567 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:26.485572 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:26.485576 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:26.486254 (+ 678us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:26.486676 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:26.487252 (+ 576us) server_negotiation.cc:299] Negotiation successful
0808 08:45:26.487796 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":467,"threads_started":1}
I20260808 08:45:26.491461 13043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85bfad35ac124c738669a577f2f22604" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35747 } }
I20260808 08:45:26.492066 13043 leader_election.cc:302] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85bfad35ac124c738669a577f2f22604; no voters:
I20260808 08:45:26.492869 13043 leader_election.cc:288] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:26.493031 13051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:26.493817 13051 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [term 1 LEADER]: Becoming Leader. State: Replica: 85bfad35ac124c738669a577f2f22604, State: Running, Role: LEADER
I20260808 08:45:26.494467 13051 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85bfad35ac124c738669a577f2f22604" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35747 } }
I20260808 08:45:26.495293 13043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:26.497929 13054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85bfad35ac124c738669a577f2f22604. Latest consensus state: current_term: 1 leader_uuid: "85bfad35ac124c738669a577f2f22604" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85bfad35ac124c738669a577f2f22604" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35747 } } }
I20260808 08:45:26.498750 13054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:26.499092 13053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85bfad35ac124c738669a577f2f22604" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85bfad35ac124c738669a577f2f22604" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35747 } } }
I20260808 08:45:26.499963 13053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:26.503510 13058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:26.509625 13058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:26.521679 13058 catalog_manager.cc:1347] Generated new cluster ID: 16919823107f4696ad3d82c8fd40c87a
I20260808 08:45:26.521837 13058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:26.543040 13058 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:26.545065 13058 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:26.554685 13058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604: Generated new TSK 0
I20260808 08:45:26.556061 13058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:45:26.651916 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35747
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:27.033910 13085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:27.034255 13085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:27.034355 13085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:27.042014 13085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:27.042161 13085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:27.042289 13085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:45:27.052814 13085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:27.054474 13085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:27.055965 13085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:27.070818 13093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:27.070888 13097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:27.070914 13095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:27.072204 13085 server_base.cc:1034] running on GCE node
I20260808 08:45:27.072975 13085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:27.074139 13085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:27.075388 13085 hybrid_clock.cc:648] HybridClock initialized: now 1786178727075343 us; error 46 us; skew 500 ppm
I20260808 08:45:27.075839 13085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:27 dist-test-slave-39l8 krb5kdc[12925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178727, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:27.079847 13085 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:45:27.081890 13085 webserver.cc:460] Webserver started at http://127.19.242.193:46653/ using document root <none> and password file <none>
I20260808 08:45:27.082868 13085 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:27.083065 13085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:27.083458 13085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:27.087270 13085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "24e376321887481bbc98c4a32b0ed024"
format_stamp: "Formatted at 2026-08-08 08:45:27 on dist-test-slave-39l8"
server_key: "8f95d2974e2bab37258008e8fbbd702d"
server_key_iv: "d6241c16c7fa2e2b50b5bd671b60af89"
server_key_version: "encryptionkey@0"
I20260808 08:45:27.088344 13085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "24e376321887481bbc98c4a32b0ed024"
format_stamp: "Formatted at 2026-08-08 08:45:27 on dist-test-slave-39l8"
server_key: "8f95d2974e2bab37258008e8fbbd702d"
server_key_iv: "d6241c16c7fa2e2b50b5bd671b60af89"
server_key_version: "encryptionkey@0"
I20260808 08:45:27.095225 13085 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 08:45:27.099987 13111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:27.101742 13085 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:45:27.101959 13085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "24e376321887481bbc98c4a32b0ed024"
format_stamp: "Formatted at 2026-08-08 08:45:27 on dist-test-slave-39l8"
server_key: "8f95d2974e2bab37258008e8fbbd702d"
server_key_iv: "d6241c16c7fa2e2b50b5bd671b60af89"
server_key_version: "encryptionkey@0"
I20260808 08:45:27.102211 13085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:27.125933 13085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:27.130975 13085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:27.131353 13085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:27.133000 13085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:27.135224 13085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:27.135361 13085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:27.135510 13085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:27.135596 13085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:27.171963 13085 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:40335
I20260808 08:45:27.172080 13296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:40335 every 8 connection(s)
I20260808 08:45:27.173437 13085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:45:27.179703 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 13085
I20260808 08:45:27.179956 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:45:27.180672 20427 external_mini_cluster.cc:1428] Setting key a5bff8bd6401811d0faa22c2d1975a07
Aug 08 08:45:27 dist-test-slave-39l8 krb5kdc[12925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178727, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:27.198916 13299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:27.176387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:59511 (local address 127.19.242.254:35747)
0808 08:45:27.176892 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:27.176897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:27.177917 (+ 1020us) server_negotiation.cc:407] Connection header received
0808 08:45:27.180057 (+ 2140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:27.180062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:27.180167 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:27.180299 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:27.182251 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.183083 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.184958 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.185393 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.185539 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:27.190034 (+ 4495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:27.190045 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:27.190053 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:27.190113 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:27.194442 (+ 4329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:27.195832 (+ 1390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:27.195842 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:27.195848 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:27.196047 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:27.196755 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:27.196763 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:27.196769 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:27.197242 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:27.197416 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:27.198331 (+ 915us) server_negotiation.cc:299] Negotiation successful
0808 08:45:27.198544 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":285,"threads_started":1}
I20260808 08:45:27.200569 13300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:27.176823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35747 (local address 127.19.242.193:59511)
0808 08:45:27.177701 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:27.177754 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:27.179666 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:27.180579 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:27.180588 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:27.181244 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:27.182054 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:27.182075 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.183266 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.183292 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:27.184790 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:27.184805 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.185666 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.185674 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:27.185926 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:27.186696 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:27.186745 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:27.189666 (+ 2921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:27.194799 (+ 5133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:27.194815 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:27.194842 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:27.195604 (+ 762us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:27.196229 (+ 625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:27.196239 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:27.196241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:27.196582 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:27.197415 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:27.197423 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:27.197853 (+ 430us) client_negotiation.cc:769] Sending connection context
0808 08:45:27.198192 (+ 339us) client_negotiation.cc:240] Negotiation successful
0808 08:45:27.198922 (+ 730us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":337,"threads_started":1}
I20260808 08:45:27.202392 13297 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35747
I20260808 08:45:27.202842 13297 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:27.203683 13297 heartbeater.cc:511] Master 127.19.242.254:35747 requested a full tablet report, sending...
I20260808 08:45:27.206234 12997 ts_manager.cc:194] Registered new tserver with Master: 24e376321887481bbc98c4a32b0ed024 (127.19.242.193:40335)
I20260808 08:45:27.208017 12997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:59511
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:45:27.260761 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35747
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:27.627780 13307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:27.628176 13307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:27.628355 13307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:27.636200 13307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:27.636384 13307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:27.636564 13307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:45:27.646999 13307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:27.648456 13307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:27.649884 13307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:27.664644 13313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:27.664644 13314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:27.664855 13316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:27.665658 13307 server_base.cc:1034] running on GCE node
I20260808 08:45:27.666429 13307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:27.667585 13307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:27.668859 13307 hybrid_clock.cc:648] HybridClock initialized: now 1786178727668803 us; error 42 us; skew 500 ppm
I20260808 08:45:27.669222 13307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:27 dist-test-slave-39l8 krb5kdc[12925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178727, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:27.677006 13307 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:45:27.678948 13307 webserver.cc:460] Webserver started at http://127.19.242.194:37871/ using document root <none> and password file <none>
I20260808 08:45:27.679718 13307 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:27.679834 13307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:27.680114 13307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:27.683422 13307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "c3cab40e80184efc96d95941e8697b30"
format_stamp: "Formatted at 2026-08-08 08:45:27 on dist-test-slave-39l8"
server_key: "3b236b9eccbf08a766513e84c8883b7f"
server_key_iv: "ca86b6e58083765eb1e8751b69d0dd29"
server_key_version: "encryptionkey@0"
I20260808 08:45:27.684460 13307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "c3cab40e80184efc96d95941e8697b30"
format_stamp: "Formatted at 2026-08-08 08:45:27 on dist-test-slave-39l8"
server_key: "3b236b9eccbf08a766513e84c8883b7f"
server_key_iv: "ca86b6e58083765eb1e8751b69d0dd29"
server_key_version: "encryptionkey@0"
I20260808 08:45:27.690675 13307 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 08:45:27.694861 13330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:27.696625 13307 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 08:45:27.696841 13307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "c3cab40e80184efc96d95941e8697b30"
format_stamp: "Formatted at 2026-08-08 08:45:27 on dist-test-slave-39l8"
server_key: "3b236b9eccbf08a766513e84c8883b7f"
server_key_iv: "ca86b6e58083765eb1e8751b69d0dd29"
server_key_version: "encryptionkey@0"
I20260808 08:45:27.697069 13307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:27.719130 13307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:27.724124 13307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:27.724488 13307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:27.725623 13307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:27.727269 13307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:27.727355 13307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:27.727510 13307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:27.727572 13307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:27.764811 13307 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:46171
I20260808 08:45:27.764921 13498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:46171 every 8 connection(s)
I20260808 08:45:27.766299 13307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:45:27.767730 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 13307
I20260808 08:45:27.767935 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:45:27.768522 20427 external_mini_cluster.cc:1428] Setting key 110941b4e695228d4c7b14aee2a21155
Aug 08 08:45:27 dist-test-slave-39l8 krb5kdc[12925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178727, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:27.790613 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:27.769691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:33327 (local address 127.19.242.254:35747)
0808 08:45:27.770230 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:27.770237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:27.771698 (+ 1461us) server_negotiation.cc:407] Connection header received
0808 08:45:27.773738 (+ 2040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:27.773746 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:27.773858 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:27.773993 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:27.775709 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.776867 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.778590 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.779415 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.779567 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:27.783563 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:27.783572 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:27.783580 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:27.783639 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:27.786756 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:27.787903 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:27.787907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:27.787909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:27.788036 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:27.788608 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:27.788611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:27.788614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:27.788897 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:27.789013 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:27.790100 (+ 1087us) server_negotiation.cc:299] Negotiation successful
0808 08:45:27.790313 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":255,"threads_started":1}
I20260808 08:45:27.792289 13503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:27.770481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35747 (local address 127.19.242.194:33327)
0808 08:45:27.771486 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:27.771538 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:27.773399 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:27.774214 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:27.774223 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:27.774871 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:27.775491 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:27.775509 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.777050 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.777055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:27.778407 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:27.778422 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:27.779683 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:27.779689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:27.779910 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:27.780688 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:27.780718 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:27.783275 (+ 2557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:27.786946 (+ 3671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:27.786960 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:27.786983 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:27.787756 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:27.788155 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:27.788162 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:27.788168 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:27.788453 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:27.789046 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:27.789057 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:27.789584 (+ 527us) client_negotiation.cc:769] Sending connection context
0808 08:45:27.789939 (+ 355us) client_negotiation.cc:240] Negotiation successful
0808 08:45:27.790632 (+ 693us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":447,"threads_started":1}
I20260808 08:45:27.794071 13499 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35747
I20260808 08:45:27.794456 13499 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:27.795468 13499 heartbeater.cc:511] Master 127.19.242.254:35747 requested a full tablet report, sending...
I20260808 08:45:27.797426 12997 ts_manager.cc:194] Registered new tserver with Master: c3cab40e80184efc96d95941e8697b30 (127.19.242.194:46171)
I20260808 08:45:27.798393 12997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:33327
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:45:27.846413 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35747
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:45:28.211853 13297 heartbeater.cc:503] Master 127.19.242.254:35747 was elected leader, sending a full tablet report...
W20260808 08:45:28.222275 13507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:28.222589 13507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:28.222779 13507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:28.230448 13507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:28.230589 13507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:28.230865 13507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:45:28.241545 13507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:35747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:28.243054 13507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:28.244517 13507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:28.259395 13515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:28.259322 13516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:28.259346 13519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:28.260968 13507 server_base.cc:1034] running on GCE node
I20260808 08:45:28.261710 13507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:28.262862 13507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:28.264111 13507 hybrid_clock.cc:648] HybridClock initialized: now 1786178728264060 us; error 64 us; skew 500 ppm
I20260808 08:45:28.264504 13507 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:28 dist-test-slave-39l8 krb5kdc[12925](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178728, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:28.268306 13507 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:45:28.270099 13507 webserver.cc:460] Webserver started at http://127.19.242.195:34397/ using document root <none> and password file <none>
I20260808 08:45:28.271023 13507 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:28.271186 13507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:28.271543 13507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:28.275102 13507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "4a4ca21940ec489c96302ad72d67af0a"
format_stamp: "Formatted at 2026-08-08 08:45:28 on dist-test-slave-39l8"
server_key: "01320a0a921bef02972af381656ac7cd"
server_key_iv: "dab8b71d36ebc0551d7d8abafb3ce1b0"
server_key_version: "encryptionkey@0"
I20260808 08:45:28.276233 13507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "4a4ca21940ec489c96302ad72d67af0a"
format_stamp: "Formatted at 2026-08-08 08:45:28 on dist-test-slave-39l8"
server_key: "01320a0a921bef02972af381656ac7cd"
server_key_iv: "dab8b71d36ebc0551d7d8abafb3ce1b0"
server_key_version: "encryptionkey@0"
I20260808 08:45:28.282805 13507 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260808 08:45:28.287005 13529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:28.288520 13507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:45:28.288743 13507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "4a4ca21940ec489c96302ad72d67af0a"
format_stamp: "Formatted at 2026-08-08 08:45:28 on dist-test-slave-39l8"
server_key: "01320a0a921bef02972af381656ac7cd"
server_key_iv: "dab8b71d36ebc0551d7d8abafb3ce1b0"
server_key_version: "encryptionkey@0"
I20260808 08:45:28.288988 13507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:28.314024 13507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:28.319211 13507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:28.319562 13507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:28.320683 13507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:28.322188 13507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:28.322307 13507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:28.322474 13507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:28.322551 13507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:28.359766 13507 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:33365
I20260808 08:45:28.359862 13708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:33365 every 8 connection(s)
I20260808 08:45:28.361231 13507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:45:28.364224 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 13507
I20260808 08:45:28.364447 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:45:28.364919 20427 external_mini_cluster.cc:1428] Setting key 2b182020b831c528bd00d9ab4f40ede7
Aug 08 08:45:28 dist-test-slave-39l8 krb5kdc[12925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178728, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:28.385429 13712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.364216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:52227 (local address 127.19.242.254:35747)
0808 08:45:28.365866 (+ 1650us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.365874 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.366542 (+ 668us) server_negotiation.cc:407] Connection header received
0808 08:45:28.369290 (+ 2748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.369294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.369380 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.369471 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:28.371394 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.372191 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.373816 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.374225 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.374324 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.378252 (+ 3928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:28.378258 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:28.378261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:28.378300 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:28.381776 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:28.382813 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:28.382817 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:28.382820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:28.382961 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:28.383538 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:28.383542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:28.383545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:28.383982 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:28.384110 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.384910 (+ 800us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.385107 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1479,"thread_start_us":1344,"threads_started":1}
I20260808 08:45:28.386425 13713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.364932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:35747 (local address 127.19.242.195:52227)
0808 08:45:28.366319 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:28.366398 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:28.368767 (+ 2369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:28.369752 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:28.369761 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:28.370352 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:28.371172 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.371235 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.372360 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.372364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.373666 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.373680 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.374437 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.374442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.374647 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.375459 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:28.375493 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:28.377988 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:28.381940 (+ 3952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:28.381948 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:28.381965 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:28.382600 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:28.383135 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:28.383139 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:28.383141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:28.383397 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:28.384117 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:28.384125 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:28.384532 (+ 407us) client_negotiation.cc:769] Sending connection context
0808 08:45:28.384786 (+ 254us) client_negotiation.cc:240] Negotiation successful
0808 08:45:28.385229 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1037,"thread_start_us":706,"threads_started":1}
I20260808 08:45:28.388139 13709 heartbeater.cc:347] Connected to a master server at 127.19.242.254:35747
I20260808 08:45:28.388531 13709 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:28.389335 13709 heartbeater.cc:511] Master 127.19.242.254:35747 requested a full tablet report, sending...
I20260808 08:45:28.391001 12997 ts_manager.cc:194] Registered new tserver with Master: 4a4ca21940ec489c96302ad72d67af0a (127.19.242.195:33365)
I20260808 08:45:28.392095 12997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:52227
I20260808 08:45:28.394680 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:45:28.415176 13712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.400137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60134 (local address 127.19.242.254:35747)
0808 08:45:28.400353 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.400359 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.400810 (+ 451us) server_negotiation.cc:407] Connection header received
0808 08:45:28.401067 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.401072 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.401150 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.401255 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:28.403348 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.404165 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.405555 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.406065 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.406260 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.409155 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:28.409161 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:28.409164 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:28.409204 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:28.412365 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:28.413178 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:28.413183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:28.413186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:28.413343 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:28.413717 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:28.413720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:28.413722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:28.414068 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:28.414256 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.414604 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.414878 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:45:28.419787 12997 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:45:28.427248 12997 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:45:28.458940 13736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.442089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:46171 (local address 127.0.0.1:41950)
0808 08:45:28.443364 (+ 1275us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:28.443421 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:28.443677 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:28.448075 (+ 4398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:28.448083 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:28.448114 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:28.448615 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.448633 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.451391 (+ 2758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.451402 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.454656 (+ 3254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.454684 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.457608 (+ 2924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.457619 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.457963 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.458052 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 08:45:28.458231 (+ 179us) client_negotiation.cc:240] Negotiation successful
0808 08:45:28.458500 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":930,"thread_start_us":5306,"threads_started":1}
I20260808 08:45:28.461369 13735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.442152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41950 (local address 127.19.242.194:46171)
0808 08:45:28.447290 (+ 5138us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.447302 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.447346 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:45:28.447474 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.447484 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.447831 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.448048 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:28.448882 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.451147 (+ 2265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.455024 (+ 3877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.457244 (+ 2220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.460457 (+ 3213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.460733 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.460820 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.461020 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4950,"thread_start_us":4809,"threads_started":1}
I20260808 08:45:28.466176 13405 tablet_service.cc:1467] Processing CreateTablet for tablet bee7cc6dc758437eac4e11c6dd83c0e9 (DEFAULT_TABLE table=test-table [id=5bdc4e5ee5614ed5ac763a1e77a2c336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:28.467962 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.442452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33365 (local address 127.0.0.1:36582)
0808 08:45:28.447707 (+ 5255us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:28.447730 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:28.447867 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:28.459877 (+ 12010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:28.459885 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:28.459917 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:28.460348 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.460364 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.462476 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.462482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.464794 (+ 2312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.464811 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.466933 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.466939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.467203 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.467249 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 08:45:28.467336 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 08:45:28.467479 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5119,"mutex_wait_us":24,"thread_start_us":5878,"threads_started":1}
I20260808 08:45:28.468626 13405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bee7cc6dc758437eac4e11c6dd83c0e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:28.469350 13737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.443353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36582 (local address 127.19.242.195:33365)
0808 08:45:28.459011 (+ 15658us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.459024 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.459065 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:45:28.459186 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.459195 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.459509 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.459762 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:28.460562 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.462296 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.465016 (+ 2720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.466652 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.468503 (+ 1851us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.468691 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.468768 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.468955 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15426,"thread_start_us":16663,"threads_started":1}
I20260808 08:45:28.470525 13736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.452420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:40335 (local address 127.0.0.1:51484)
0808 08:45:28.459234 (+ 6814us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:28.459253 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:28.459358 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:28.463168 (+ 3810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:28.463174 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:28.463205 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:28.463470 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.463481 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.465601 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.465607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.467695 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.467709 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.469709 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.469716 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.469914 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.469948 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:45:28.470017 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 08:45:28.470160 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6711,"mutex_wait_us":83,"thread_start_us":9318,"threads_started":1}
I20260808 08:45:28.471684 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.448666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51484 (local address 127.19.242.193:40335)
0808 08:45:28.462431 (+ 13765us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.462443 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.462475 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:45:28.462585 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.462595 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.462920 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.463681 (+ 761us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:28.463924 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.465418 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.467908 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.469449 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.470897 (+ 1448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.471070 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.471149 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.471321 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13546,"threads_started":1}
I20260808 08:45:28.473659 13605 tablet_service.cc:1467] Processing CreateTablet for tablet bee7cc6dc758437eac4e11c6dd83c0e9 (DEFAULT_TABLE table=test-table [id=5bdc4e5ee5614ed5ac763a1e77a2c336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:28.475394 13605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bee7cc6dc758437eac4e11c6dd83c0e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:28.476068 13187 tablet_service.cc:1467] Processing CreateTablet for tablet bee7cc6dc758437eac4e11c6dd83c0e9 (DEFAULT_TABLE table=test-table [id=5bdc4e5ee5614ed5ac763a1e77a2c336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:28.477604 13187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bee7cc6dc758437eac4e11c6dd83c0e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:28.484256 13740 tablet_bootstrap.cc:492] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Bootstrap starting.
I20260808 08:45:28.487578 13740 tablet_bootstrap.cc:654] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:28.489049 13740 log.cc:824] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:28.492118 13740 tablet_bootstrap.cc:492] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: No bootstrap required, opened a new log
I20260808 08:45:28.492453 13740 ts_tablet_manager.cc:1397] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:45:28.493125 13743 tablet_bootstrap.cc:492] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Bootstrap starting.
I20260808 08:45:28.495373 13744 tablet_bootstrap.cc:492] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Bootstrap starting.
I20260808 08:45:28.497830 13743 tablet_bootstrap.cc:654] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:28.498832 13744 tablet_bootstrap.cc:654] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:28.499616 13743 log.cc:824] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:28.500102 13744 log.cc:824] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:28.503347 13740 raft_consensus.cc:348] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.503619 13743 tablet_bootstrap.cc:492] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: No bootstrap required, opened a new log
I20260808 08:45:28.503754 13740 raft_consensus.cc:374] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:28.503854 13740 raft_consensus.cc:729] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3cab40e80184efc96d95941e8697b30, State: Initialized, Role: FOLLOWER
I20260808 08:45:28.503959 13743 ts_tablet_manager.cc:1397] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260808 08:45:28.504555 13740 consensus_queue.cc:260] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.505781 13499 heartbeater.cc:503] Master 127.19.242.254:35747 was elected leader, sending a full tablet report...
I20260808 08:45:28.506026 13744 tablet_bootstrap.cc:492] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: No bootstrap required, opened a new log
I20260808 08:45:28.506312 13744 ts_tablet_manager.cc:1397] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260808 08:45:28.506613 13740 ts_tablet_manager.cc:1428] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260808 08:45:28.513468 13743 raft_consensus.cc:348] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.514046 13743 raft_consensus.cc:374] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:28.514185 13743 raft_consensus.cc:729] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a4ca21940ec489c96302ad72d67af0a, State: Initialized, Role: FOLLOWER
I20260808 08:45:28.514868 13743 consensus_queue.cc:260] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.516140 13709 heartbeater.cc:503] Master 127.19.242.254:35747 was elected leader, sending a full tablet report...
I20260808 08:45:28.516686 13743 ts_tablet_manager.cc:1428] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260808 08:45:28.516358 13744 raft_consensus.cc:348] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.516848 13744 raft_consensus.cc:374] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:28.516958 13744 raft_consensus.cc:729] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24e376321887481bbc98c4a32b0ed024, State: Initialized, Role: FOLLOWER
I20260808 08:45:28.517612 13744 consensus_queue.cc:260] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
W20260808 08:45:28.519104 13500 tablet.cc:2369] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:28.519654 13744 ts_tablet_manager.cc:1428] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
W20260808 08:45:28.613034 13711 tablet.cc:2369] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:28.666045 13749 raft_consensus.cc:482] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:45:28.666440 13749 raft_consensus.cc:504] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.668438 13749 leader_election.cc:288] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3cab40e80184efc96d95941e8697b30 (127.19.242.194:46171), 24e376321887481bbc98c4a32b0ed024 (127.19.242.193:40335)
I20260808 08:45:28.674541 13713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.668711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:46171 (local address 127.19.242.195:44703)
0808 08:45:28.668927 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:28.668950 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:28.669095 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:28.669485 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:28.669490 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:28.669521 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:28.669771 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.669788 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.670909 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.670914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.672661 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.672676 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.673856 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.673862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.674101 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.674127 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:45:28.674214 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 08:45:28.674318 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:45:28.674731 13735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.668881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:44703 (local address 127.19.242.194:46171)
0808 08:45:28.669100 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.669109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.669137 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:45:28.669223 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.669228 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.669324 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.669455 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:28.669983 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.670755 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.672843 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.673665 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.673803 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.673860 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.674287 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.674439 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:45:28.676043 13431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bee7cc6dc758437eac4e11c6dd83c0e9" candidate_uuid: "4a4ca21940ec489c96302ad72d67af0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3cab40e80184efc96d95941e8697b30" is_pre_election: true
W20260808 08:45:28.676287 13298 tablet.cc:2369] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:28.676537 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.669437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:34693 (local address 127.19.242.193:40335)
0808 08:45:28.669716 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.669724 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.670208 (+ 484us) server_negotiation.cc:407] Connection header received
0808 08:45:28.670413 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.670418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.670514 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.670619 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:28.671346 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.672047 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.674020 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.675297 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.675441 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.675494 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.676027 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.676165 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:45:28.676700 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.669203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:40335 (local address 127.19.242.195:34693)
0808 08:45:28.670096 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:28.670116 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:28.670259 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:28.670642 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:28.670653 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:28.670679 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:28.671165 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.671177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.672216 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.672222 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.673857 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:28.673870 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.675635 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.675641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:28.675820 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.675859 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:45:28.675973 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 08:45:28.676137 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"thread_start_us":529,"threads_started":1}
I20260808 08:45:28.676741 13431 raft_consensus.cc:2454] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a4ca21940ec489c96302ad72d67af0a in term 0.
I20260808 08:45:28.677577 13537 leader_election.cc:302] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a4ca21940ec489c96302ad72d67af0a, c3cab40e80184efc96d95941e8697b30; no voters:
I20260808 08:45:28.677754 13220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bee7cc6dc758437eac4e11c6dd83c0e9" candidate_uuid: "4a4ca21940ec489c96302ad72d67af0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24e376321887481bbc98c4a32b0ed024" is_pre_election: true
I20260808 08:45:28.678026 13749 raft_consensus.cc:2781] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:45:28.678194 13749 raft_consensus.cc:482] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:45:28.678310 13749 raft_consensus.cc:3037] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:28.678375 13220 raft_consensus.cc:2454] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a4ca21940ec489c96302ad72d67af0a in term 0.
I20260808 08:45:28.680835 13749 raft_consensus.cc:504] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.681391 13749 leader_election.cc:288] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [CANDIDATE]: Term 1 election: Requested vote from peers c3cab40e80184efc96d95941e8697b30 (127.19.242.194:46171), 24e376321887481bbc98c4a32b0ed024 (127.19.242.193:40335)
I20260808 08:45:28.682037 13431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bee7cc6dc758437eac4e11c6dd83c0e9" candidate_uuid: "4a4ca21940ec489c96302ad72d67af0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3cab40e80184efc96d95941e8697b30"
I20260808 08:45:28.682133 13220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bee7cc6dc758437eac4e11c6dd83c0e9" candidate_uuid: "4a4ca21940ec489c96302ad72d67af0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24e376321887481bbc98c4a32b0ed024"
I20260808 08:45:28.682301 13431 raft_consensus.cc:3037] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:28.682355 13220 raft_consensus.cc:3037] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:28.685868 13431 raft_consensus.cc:2454] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a4ca21940ec489c96302ad72d67af0a in term 1.
I20260808 08:45:28.685868 13220 raft_consensus.cc:2454] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a4ca21940ec489c96302ad72d67af0a in term 1.
I20260808 08:45:28.686394 13537 leader_election.cc:302] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a4ca21940ec489c96302ad72d67af0a, c3cab40e80184efc96d95941e8697b30; no voters:
I20260808 08:45:28.686841 13749 raft_consensus.cc:2781] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:28.687475 13749 raft_consensus.cc:686] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 1 LEADER]: Becoming Leader. State: Replica: 4a4ca21940ec489c96302ad72d67af0a, State: Running, Role: LEADER
I20260808 08:45:28.688444 13749 consensus_queue.cc:237] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } }
I20260808 08:45:28.693739 12995 catalog_manager.cc:5495] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a4ca21940ec489c96302ad72d67af0a (127.19.242.195). New cstate: current_term: 1 leader_uuid: "4a4ca21940ec489c96302ad72d67af0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a4ca21940ec489c96302ad72d67af0a" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 } health_report { overall_health: UNKNOWN } } }
I20260808 08:45:28.760543 13737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.754407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36596 (local address 127.19.242.195:33365)
0808 08:45:28.754656 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.754662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.754681 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:45:28.754934 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.754938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.755021 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.755218 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:45:28.755591 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.756413 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.758031 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.758509 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.758625 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.759291 (+ 666us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:45:28.759840 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:45:28.759962 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.760089 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.760208 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:45:28.770349 13431 raft_consensus.cc:1261] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 1 FOLLOWER]: Refusing update from remote peer 4a4ca21940ec489c96302ad72d67af0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:28.770362 13220 raft_consensus.cc:1261] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 1 FOLLOWER]: Refusing update from remote peer 4a4ca21940ec489c96302ad72d67af0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:28.771502 13755 consensus_queue.cc:1035] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "24e376321887481bbc98c4a32b0ed024" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 40335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:28.771940 13749 consensus_queue.cc:1035] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3cab40e80184efc96d95941e8697b30" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:28.789212 13761 mvcc.cc:205] Tried to move back new op lower bound from 7316188073031143424 to 7316188072712818688. Current Snapshot: MvccSnapshot[applied={T|T < 7316188073031143424}]
I20260808 08:45:28.803483 12997 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:28.803795 12997 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:28.807986 12997 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85bfad35ac124c738669a577f2f22604: Sending DeleteTablet for 3 replicas of tablet bee7cc6dc758437eac4e11c6dd83c0e9
I20260808 08:45:28.809429 13405 tablet_service.cc:1514] Processing DeleteTablet for tablet bee7cc6dc758437eac4e11c6dd83c0e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:28 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:41950
I20260808 08:45:28.809408 13605 tablet_service.cc:1514] Processing DeleteTablet for tablet bee7cc6dc758437eac4e11c6dd83c0e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:28 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:36582
I20260808 08:45:28.810474 13187 tablet_service.cc:1514] Processing DeleteTablet for tablet bee7cc6dc758437eac4e11c6dd83c0e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:28 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:51484
I20260808 08:45:28.814021 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 13085
I20260808 08:45:28.827564 13774 tablet_replica.cc:330] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: stopping tablet replica
I20260808 08:45:28.828263 13774 raft_consensus.cc:2229] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:28.828990 13774 raft_consensus.cc:2258] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:28.830075 13772 tablet_replica.cc:330] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: stopping tablet replica
I20260808 08:45:28.830686 13772 raft_consensus.cc:2229] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:28.831377 13772 raft_consensus.cc:2258] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:28.833964 13772 ts_tablet_manager.cc:1905] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:28.834195 13774 ts_tablet_manager.cc:1905] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:28.842351 13772 ts_tablet_manager.cc:1918] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:28.843250 13772 log.cc:1196] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/bee7cc6dc758437eac4e11c6dd83c0e9
I20260808 08:45:28.843439 13773 tablet_replica.cc:330] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: stopping tablet replica
I20260808 08:45:28.843931 13772 ts_tablet_manager.cc:1939] T bee7cc6dc758437eac4e11c6dd83c0e9 P c3cab40e80184efc96d95941e8697b30: Deleting consensus metadata
I20260808 08:45:28.844024 13773 raft_consensus.cc:2229] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:45:28.844799 13773 raft_consensus.cc:2258] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:28.846131 12977 catalog_manager.cc:4841] TS c3cab40e80184efc96d95941e8697b30 (127.19.242.194:46171): tablet bee7cc6dc758437eac4e11c6dd83c0e9 (table test-table [id=5bdc4e5ee5614ed5ac763a1e77a2c336]) successfully deleted
I20260808 08:45:28.847371 13774 ts_tablet_manager.cc:1918] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:28.847579 13774 log.cc:1196] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/bee7cc6dc758437eac4e11c6dd83c0e9
I20260808 08:45:28.847715 13773 ts_tablet_manager.cc:1905] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:28.848179 13774 ts_tablet_manager.cc:1939] T bee7cc6dc758437eac4e11c6dd83c0e9 P 24e376321887481bbc98c4a32b0ed024: Deleting consensus metadata
I20260808 08:45:28.850116 12977 catalog_manager.cc:4841] TS 24e376321887481bbc98c4a32b0ed024 (127.19.242.193:40335): tablet bee7cc6dc758437eac4e11c6dd83c0e9 (table test-table [id=5bdc4e5ee5614ed5ac763a1e77a2c336]) successfully deleted
Aug 08 08:45:28 dist-test-slave-39l8 krb5kdc[12925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:45:28.855271 13773 ts_tablet_manager.cc:1918] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:28.855494 13773 log.cc:1196] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/bee7cc6dc758437eac4e11c6dd83c0e9
I20260808 08:45:28.856048 13773 ts_tablet_manager.cc:1939] T bee7cc6dc758437eac4e11c6dd83c0e9 P 4a4ca21940ec489c96302ad72d67af0a: Deleting consensus metadata
I20260808 08:45:28.857981 12973 catalog_manager.cc:4841] TS 4a4ca21940ec489c96302ad72d67af0a (127.19.242.195:33365): tablet bee7cc6dc758437eac4e11c6dd83c0e9 (table test-table [id=5bdc4e5ee5614ed5ac763a1e77a2c336]) successfully deleted
I20260808 08:45:28.860903 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.815426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.19.242.193:40335)
0808 08:45:28.815631 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.815638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.826363 (+ 10725us) server_negotiation.cc:407] Connection header received
0808 08:45:28.826846 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.826854 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.826967 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.827108 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:28.829690 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.831041 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.844344 (+ 13303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.845037 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.845155 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:28.852923 (+ 7768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:28.852943 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:28.852964 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:28.853021 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:28.857266 (+ 4245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:28.858345 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:28.858353 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:28.858356 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:28.858506 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:28.859047 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:28.859051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:28.859054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:28.859438 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:28.859775 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:28.860130 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 08:45:28.860396 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:45:28.861703 13286 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:28.953454 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 13085
I20260808 08:45:28.989830 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 13307
Aug 08 08:45:28 dist-test-slave-39l8 krb5kdc[12925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:45:29.008657 13735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:28.990825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41952 (local address 127.19.242.194:46171)
0808 08:45:28.991014 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:28.991020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:28.991043 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:45:28.991168 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:28.991181 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:28.991260 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:28.991373 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:28.992808 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.994061 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.995586 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:28.996262 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:28.996413 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:29.001454 (+ 5041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:29.001471 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:29.001488 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:29.001534 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:29.004912 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:29.006018 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:29.006027 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:29.006030 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:29.006216 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:29.006686 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:29.006690 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:29.006692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:29.007398 (+ 706us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:29.007694 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:29.008087 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 08:45:29.008293 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:45:29.009470 13490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:29.113557 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 13307
I20260808 08:45:29.140811 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 13507
Aug 08 08:45:29 dist-test-slave-39l8 krb5kdc[12925](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:45:29.161473 13737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:29.142300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36612 (local address 127.19.242.195:33365)
0808 08:45:29.142515 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:29.142523 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:29.142544 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:45:29.142868 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:29.142875 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:29.142967 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:29.143117 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:29.144594 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:29.145861 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:29.147340 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:29.148060 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:29.148227 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:29.153436 (+ 5209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:29.153459 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:29.153477 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:29.153524 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:29.157480 (+ 3956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:29.158666 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:29.158676 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:29.158683 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:29.158997 (+ 314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:29.159571 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:29.159576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:29.159578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:29.160026 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:29.160319 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:29.160766 (+ 447us) server_negotiation.cc:299] Negotiation successful
0808 08:45:29.160966 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:45:29.162330 13703 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:29.289901 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 13507
I20260808 08:45:29.319126 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 12942
I20260808 08:45:29.320482 13036 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:29.432336 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 12942
2026-08-08T08:45:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5234 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T08:45:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:29Z Disabled control of system clock
I20260808 08:45:29.544656 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43635
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:39937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:43635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:45:29.923156 13787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:29.923493 13787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:29.923579 13787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:29.931428 13787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:29.931559 13787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:29.931598 13787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:29.931651 13787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:29.931697 13787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:29.941391 13787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:39937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:43635
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:29.942756 13787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:29.944628 13787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:29.957625 13797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:29.957726 13800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:29.957662 13795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:29.958910 13787 server_base.cc:1034] running on GCE node
I20260808 08:45:29.959861 13787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:29.961424 13787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:29.962661 13787 hybrid_clock.cc:648] HybridClock initialized: now 1786178729962599 us; error 68 us; skew 500 ppm
I20260808 08:45:29.963207 13787 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:29.965986 13787 webserver.cc:460] Webserver started at http://127.19.242.254:39509/ using document root <none> and password file <none>
I20260808 08:45:29.966907 13787 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:29.967041 13787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:29.967427 13787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:29.970885 13787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "0b331d7453924543b2a3be6412abb3db"
format_stamp: "Formatted at 2026-08-08 08:45:29 on dist-test-slave-39l8"
server_key: "f3fca73768ae8db81079a953192c215a"
server_key_iv: "76e8347a47ae14f191aff41b5e851417"
server_key_version: "encryptionkey@0"
I20260808 08:45:29.971851 13787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "0b331d7453924543b2a3be6412abb3db"
format_stamp: "Formatted at 2026-08-08 08:45:29 on dist-test-slave-39l8"
server_key: "f3fca73768ae8db81079a953192c215a"
server_key_iv: "76e8347a47ae14f191aff41b5e851417"
server_key_version: "encryptionkey@0"
I20260808 08:45:29.977937 13787 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 08:45:29.982342 13808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:29.984095 13787 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:29.984357 13787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "0b331d7453924543b2a3be6412abb3db"
format_stamp: "Formatted at 2026-08-08 08:45:29 on dist-test-slave-39l8"
server_key: "f3fca73768ae8db81079a953192c215a"
server_key_iv: "76e8347a47ae14f191aff41b5e851417"
server_key_version: "encryptionkey@0"
I20260808 08:45:29.984618 13787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:30.035813 13787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:30.036805 13787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:30.037139 13787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:30.057428 13787 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:43635
I20260808 08:45:30.057451 13878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:43635 every 8 connection(s)
I20260808 08:45:30.059031 13787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:30.060513 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 13787
I20260808 08:45:30.060712 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:30.061364 20427 external_mini_cluster.cc:1428] Setting key d9d68d1d4284a7923a53837933060b70
I20260808 08:45:30.065637 13879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:30.076090 13883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:30.063429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36948 (local address 127.19.242.254:43635)
0808 08:45:30.064450 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:30.064463 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:30.064508 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:45:30.066346 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:30.066372 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:30.066949 (+ 577us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:30.067357 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:30.067978 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:30.069452 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:30.071071 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:30.071871 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:30.072124 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:30.073429 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:30.073438 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:30.073454 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:30.074056 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:30.074136 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:30.074159 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:30.074314 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:30.074595 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 08:45:30.074986 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":349,"threads_started":1}
I20260808 08:45:30.078586 13879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db: Bootstrap starting.
I20260808 08:45:30.082332 13879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:30.083632 13879 log.cc:824] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:30.087412 13879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db: No bootstrap required, opened a new log
I20260808 08:45:30.096874 13879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b331d7453924543b2a3be6412abb3db" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43635 } }
I20260808 08:45:30.097529 13879 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:30.097667 13879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b331d7453924543b2a3be6412abb3db, State: Initialized, Role: FOLLOWER
I20260808 08:45:30.098344 13879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b331d7453924543b2a3be6412abb3db" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43635 } }
I20260808 08:45:30.098620 13879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:30.098868 13879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:30.099092 13879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:30.101537 13879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b331d7453924543b2a3be6412abb3db" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43635 } }
I20260808 08:45:30.102197 13879 leader_election.cc:302] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b331d7453924543b2a3be6412abb3db; no voters:
I20260808 08:45:30.103032 13879 leader_election.cc:288] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:30.103202 13886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:30.104233 13886 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [term 1 LEADER]: Becoming Leader. State: Replica: 0b331d7453924543b2a3be6412abb3db, State: Running, Role: LEADER
I20260808 08:45:30.104791 13886 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b331d7453924543b2a3be6412abb3db" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43635 } }
I20260808 08:45:30.105538 13879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:30.108011 13889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b331d7453924543b2a3be6412abb3db. Latest consensus state: current_term: 1 leader_uuid: "0b331d7453924543b2a3be6412abb3db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b331d7453924543b2a3be6412abb3db" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43635 } } }
I20260808 08:45:30.108253 13887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b331d7453924543b2a3be6412abb3db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b331d7453924543b2a3be6412abb3db" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43635 } } }
I20260808 08:45:30.108572 13889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:30.108568 13887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:30.112532 13898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:30.118172 13898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:30.128599 13898 catalog_manager.cc:1347] Generated new cluster ID: dafcd9da007444cf839b8c3326c58169
I20260808 08:45:30.128780 13898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:30.145385 13898 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:30.147523 13898 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:30.164685 13898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db: Generated new TSK 0
I20260808 08:45:30.165990 13898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:45:30.179605 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:43635
--builtin_ntp_servers=127.19.242.212:39937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:45:30.559187 13914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:30.559561 13914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:30.559742 13914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:30.567453 13914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:30.567615 13914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:30.567807 13914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:45:30.577996 13914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:39937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:30.579528 13914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:30.581478 13914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:30.596848 13920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:30.596900 13928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:30.596792 13923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:30.600484 13914 server_base.cc:1034] running on GCE node
I20260808 08:45:30.601245 13914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:30.602346 13914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:30.603596 13914 hybrid_clock.cc:648] HybridClock initialized: now 1786178730603541 us; error 42 us; skew 500 ppm
I20260808 08:45:30.604036 13914 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:30.607082 13914 webserver.cc:460] Webserver started at http://127.19.242.193:43663/ using document root <none> and password file <none>
I20260808 08:45:30.607894 13914 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:30.607993 13914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:30.608397 13914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:30.612596 13914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "447d1cea02aa4940bc73f56bff53e90b"
format_stamp: "Formatted at 2026-08-08 08:45:30 on dist-test-slave-39l8"
server_key: "8347fdeded0cd1aff146c8fa05fea2ab"
server_key_iv: "613cd1a4c3bd114ba5a50f12c4e0de9f"
server_key_version: "encryptionkey@0"
I20260808 08:45:30.613533 13914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "447d1cea02aa4940bc73f56bff53e90b"
format_stamp: "Formatted at 2026-08-08 08:45:30 on dist-test-slave-39l8"
server_key: "8347fdeded0cd1aff146c8fa05fea2ab"
server_key_iv: "613cd1a4c3bd114ba5a50f12c4e0de9f"
server_key_version: "encryptionkey@0"
I20260808 08:45:30.619688 13914 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:45:30.624042 13936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:30.625865 13914 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:45:30.626101 13914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "447d1cea02aa4940bc73f56bff53e90b"
format_stamp: "Formatted at 2026-08-08 08:45:30 on dist-test-slave-39l8"
server_key: "8347fdeded0cd1aff146c8fa05fea2ab"
server_key_iv: "613cd1a4c3bd114ba5a50f12c4e0de9f"
server_key_version: "encryptionkey@0"
I20260808 08:45:30.626375 13914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:30.649858 13914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:30.650887 13914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:30.651235 13914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:30.652343 13914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:30.654031 13914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:30.654165 13914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:30.654364 13914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:30.654464 13914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:30.691437 13914 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:37979
I20260808 08:45:30.691534 14114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:37979 every 8 connection(s)
I20260808 08:45:30.692934 13914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:45:30.698834 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 13914
I20260808 08:45:30.699045 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:45:30.699643 20427 external_mini_cluster.cc:1428] Setting key a96dd7c7c726fb85db6ce2d02fd48881
I20260808 08:45:30.703048 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:43635
--builtin_ntp_servers=127.19.242.212:39937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:45:30.709481 14118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:30.695902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:35731 (local address 127.19.242.254:43635)
0808 08:45:30.696426 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:30.696433 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:30.697689 (+ 1256us) server_negotiation.cc:407] Connection header received
0808 08:45:30.700346 (+ 2657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:30.700354 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:30.700479 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:30.700624 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:30.702228 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:30.703034 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:30.705857 (+ 2823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:30.706322 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:30.706630 (+ 308us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:30.708481 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:30.708487 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:30.708491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:30.708512 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:30.708558 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:30.708574 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:30.708657 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:30.708949 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 08:45:30.709039 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":257,"threads_started":1}
I20260808 08:45:30.710999 14119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:30.696556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:43635 (local address 127.19.242.193:35731)
0808 08:45:30.697503 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:30.697553 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:30.699894 (+ 2341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:30.700975 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:30.700987 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:30.701158 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:30.701987 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:30.702026 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:30.703237 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:30.703245 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:30.705684 (+ 2439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:30.705707 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:30.706749 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:30.706760 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:30.707139 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:30.708044 (+ 905us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:30.708049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:30.708111 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:30.708249 (+ 138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:30.708686 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:30.708700 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:30.708712 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:45:30.708920 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 08:45:30.709440 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":288,"threads_started":1}
I20260808 08:45:30.713055 14116 heartbeater.cc:347] Connected to a master server at 127.19.242.254:43635
I20260808 08:45:30.713438 14116 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:30.714493 14116 heartbeater.cc:511] Master 127.19.242.254:43635 requested a full tablet report, sending...
I20260808 08:45:30.717178 13832 ts_manager.cc:194] Registered new tserver with Master: 447d1cea02aa4940bc73f56bff53e90b (127.19.242.193:37979)
I20260808 08:45:30.719270 13832 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.193:35731
W20260808 08:45:31.090581 14121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:31.091006 14121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:31.091117 14121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:31.099502 14121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:31.099625 14121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:31.099733 14121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:45:31.109527 14121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:39937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:31.111186 14121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:31.113097 14121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:31.127449 14131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:31.127512 14130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:31.127471 14135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:31.128485 14121 server_base.cc:1034] running on GCE node
I20260808 08:45:31.129288 14121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:31.130517 14121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:31.131856 14121 hybrid_clock.cc:648] HybridClock initialized: now 1786178731131744 us; error 90 us; skew 500 ppm
I20260808 08:45:31.132275 14121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:31.135030 14121 webserver.cc:460] Webserver started at http://127.19.242.194:36591/ using document root <none> and password file <none>
I20260808 08:45:31.135886 14121 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:31.136021 14121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:31.136385 14121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:31.139729 14121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "0fe36365bc214c1fb4ab4163847f2357"
format_stamp: "Formatted at 2026-08-08 08:45:31 on dist-test-slave-39l8"
server_key: "47fd48a3404799e4920aa82115ee04ab"
server_key_iv: "44555a3feeabb47db73d269ce340aaa1"
server_key_version: "encryptionkey@0"
I20260808 08:45:31.140595 14121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "0fe36365bc214c1fb4ab4163847f2357"
format_stamp: "Formatted at 2026-08-08 08:45:31 on dist-test-slave-39l8"
server_key: "47fd48a3404799e4920aa82115ee04ab"
server_key_iv: "44555a3feeabb47db73d269ce340aaa1"
server_key_version: "encryptionkey@0"
I20260808 08:45:31.146355 14121 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:45:31.151640 14141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:31.153319 14121 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:45:31.153515 14121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "0fe36365bc214c1fb4ab4163847f2357"
format_stamp: "Formatted at 2026-08-08 08:45:31 on dist-test-slave-39l8"
server_key: "47fd48a3404799e4920aa82115ee04ab"
server_key_iv: "44555a3feeabb47db73d269ce340aaa1"
server_key_version: "encryptionkey@0"
I20260808 08:45:31.153787 14121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:31.185333 14121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:31.186285 14121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:31.186619 14121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:31.187747 14121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:31.189504 14121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:31.189637 14121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:31.189782 14121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:31.189873 14121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:31.225669 14121 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:43893
I20260808 08:45:31.225769 14291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:43893 every 8 connection(s)
I20260808 08:45:31.227152 14121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:45:31.232633 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 14121
I20260808 08:45:31.232877 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:45:31.233381 20427 external_mini_cluster.cc:1428] Setting key 6dd762896a6db3ceb820820b3fc42e81
I20260808 08:45:31.236801 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:43635
--builtin_ntp_servers=127.19.242.212:39937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:45:31.243257 14294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.229993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:54527 (local address 127.19.242.254:43635)
0808 08:45:31.230514 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.230519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.232307 (+ 1788us) server_negotiation.cc:407] Connection header received
0808 08:45:31.234850 (+ 2543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.234854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.234925 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.235032 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:31.236552 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.237392 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.239240 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.239696 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.239848 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.241771 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:31.241781 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:31.241789 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:31.241821 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:31.241881 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:31.241902 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:31.242020 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.242731 (+ 711us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.242846 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":286,"threads_started":1}
I20260808 08:45:31.244210 14295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.230685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:43635 (local address 127.19.242.194:54527)
0808 08:45:31.232050 (+ 1365us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:31.232115 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:31.234451 (+ 2336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:31.235368 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:31.235382 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:31.235561 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:31.236339 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.236359 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.237612 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.237616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.239060 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.239077 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.239967 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.239975 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.240248 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.241258 (+ 1010us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:31.241262 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:31.241336 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:31.241461 (+ 125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:31.242055 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:31.242069 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:31.242079 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:45:31.242337 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 08:45:31.242863 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":292,"threads_started":1}
I20260808 08:45:31.246059 14292 heartbeater.cc:347] Connected to a master server at 127.19.242.254:43635
I20260808 08:45:31.246385 14292 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:31.247336 14292 heartbeater.cc:511] Master 127.19.242.254:43635 requested a full tablet report, sending...
I20260808 08:45:31.249082 13832 ts_manager.cc:194] Registered new tserver with Master: 0fe36365bc214c1fb4ab4163847f2357 (127.19.242.194:43893)
I20260808 08:45:31.249940 13832 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.194:54527
W20260808 08:45:31.636281 14296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:31.636656 14296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:31.636838 14296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:31.644472 14296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:31.644652 14296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:31.644840 14296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:45:31.654623 14296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:39937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:31.656144 14296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:31.658308 14296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:31.673463 14309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:31.673591 14306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:31.673539 14305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:31.674408 14296 server_base.cc:1034] running on GCE node
I20260808 08:45:31.675220 14296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:31.676399 14296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:31.677676 14296 hybrid_clock.cc:648] HybridClock initialized: now 1786178731677615 us; error 57 us; skew 500 ppm
I20260808 08:45:31.678104 14296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:31.681020 14296 webserver.cc:460] Webserver started at http://127.19.242.195:35631/ using document root <none> and password file <none>
I20260808 08:45:31.681948 14296 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:31.682101 14296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:31.682459 14296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:31.685703 14296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "1f0933e210774a3cbc409cc51d74738d"
format_stamp: "Formatted at 2026-08-08 08:45:31 on dist-test-slave-39l8"
server_key: "b81c1d330e9393f1cb317dbc855c7f19"
server_key_iv: "a0ba47ec1c5b707d66cc395258cffeb3"
server_key_version: "encryptionkey@0"
I20260808 08:45:31.686638 14296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "1f0933e210774a3cbc409cc51d74738d"
format_stamp: "Formatted at 2026-08-08 08:45:31 on dist-test-slave-39l8"
server_key: "b81c1d330e9393f1cb317dbc855c7f19"
server_key_iv: "a0ba47ec1c5b707d66cc395258cffeb3"
server_key_version: "encryptionkey@0"
I20260808 08:45:31.693421 14296 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:45:31.699119 14321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:31.701560 14296 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:45:31.701949 14296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "1f0933e210774a3cbc409cc51d74738d"
format_stamp: "Formatted at 2026-08-08 08:45:31 on dist-test-slave-39l8"
server_key: "b81c1d330e9393f1cb317dbc855c7f19"
server_key_iv: "a0ba47ec1c5b707d66cc395258cffeb3"
server_key_version: "encryptionkey@0"
I20260808 08:45:31.702322 14296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:31.723043 14116 heartbeater.cc:503] Master 127.19.242.254:43635 was elected leader, sending a full tablet report...
I20260808 08:45:31.733179 14296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:31.734292 14296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:31.734618 14296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:31.735850 14296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:31.737534 14296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:31.737636 14296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:31.737742 14296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:31.737810 14296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:31.777786 14296 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:42983
I20260808 08:45:31.777894 14502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:42983 every 8 connection(s)
I20260808 08:45:31.779386 14296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:45:31.786386 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 14296
I20260808 08:45:31.786623 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:45:31.787240 20427 external_mini_cluster.cc:1428] Setting key 9236371924b9b9dbe11b5796af765533
I20260808 08:45:31.794768 14506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.782338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:50005 (local address 127.19.242.254:43635)
0808 08:45:31.782860 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.782864 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.784314 (+ 1450us) server_negotiation.cc:407] Connection header received
0808 08:45:31.786596 (+ 2282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.786603 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.786772 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.786903 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:31.788477 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.789510 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.791577 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.792076 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.792199 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.793873 (+ 1674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:31.793880 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:31.793883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:31.793903 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:31.793950 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:31.793963 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:31.794046 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.794286 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.794382 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":224,"threads_started":1}
I20260808 08:45:31.795861 14507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.783119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:43635 (local address 127.19.242.195:50005)
0808 08:45:31.784112 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:31.784154 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:31.786050 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:31.787229 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:31.787244 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:31.787397 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:31.788255 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.788285 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.789690 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.789694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.791411 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.791431 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.792356 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.792364 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.792652 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.793483 (+ 831us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:31.793485 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:31.793531 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:31.793628 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:31.794059 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:31.794068 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:31.794074 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:45:31.794242 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:45:31.794580 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":308,"threads_started":1}
I20260808 08:45:31.797523 14504 heartbeater.cc:347] Connected to a master server at 127.19.242.254:43635
I20260808 08:45:31.797875 14504 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:31.798866 14504 heartbeater.cc:511] Master 127.19.242.254:43635 requested a full tablet report, sending...
I20260808 08:45:31.800586 13832 ts_manager.cc:194] Registered new tserver with Master: 1f0933e210774a3cbc409cc51d74738d (127.19.242.195:42983)
I20260808 08:45:31.801584 13832 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.195:50005
I20260808 08:45:31.804015 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:45:31.815641 14506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.809151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60776 (local address 127.19.242.254:43635)
0808 08:45:31.809408 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.809416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.810032 (+ 616us) server_negotiation.cc:407] Connection header received
0808 08:45:31.810215 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.810219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.810289 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.810386 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:31.811035 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.811771 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.813277 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.813696 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.813799 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.815012 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:31.815017 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:31.815020 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:31.815041 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:31.815088 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:31.815100 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:31.815175 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.815309 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.815394 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:45:31.820209 13831 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:45:31.827544 13831 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:45:31.852982 14522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.843461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51190)
0808 08:45:31.845034 (+ 1573us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:31.845054 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:31.845179 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:31.846119 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:31.846125 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:31.846150 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:31.846584 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.846604 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.848330 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.848338 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.849740 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.849755 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.851875 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.851881 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.852147 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.852205 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 08:45:31.852362 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 08:45:31.852587 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1434,"thread_start_us":1272,"threads_started":1}
I20260808 08:45:31.853055 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.843869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51190 (local address 127.19.242.193:37979)
0808 08:45:31.844706 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.844718 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.845312 (+ 594us) server_negotiation.cc:407] Connection header received
0808 08:45:31.845427 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.845434 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.845669 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.845889 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:31.846891 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.848191 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.849958 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.851653 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.851874 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.852134 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.852438 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.852633 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":505,"threads_started":1}
I20260808 08:45:31.854022 14520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.840983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:43893 (local address 127.0.0.1:49810)
0808 08:45:31.842336 (+ 1353us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:31.842394 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:31.842622 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:31.843556 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:31.843568 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:31.843606 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:31.844017 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.844034 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.846603 (+ 2569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.846616 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.851289 (+ 4673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.851303 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.853217 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.853224 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.853393 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.853430 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:45:31.853562 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 08:45:31.853714 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1027,"thread_start_us":1610,"threads_started":1}
I20260808 08:45:31.854571 14521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.841206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49810 (local address 127.19.242.194:43893)
0808 08:45:31.841910 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.841923 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.842531 (+ 608us) server_negotiation.cc:407] Connection header received
0808 08:45:31.842918 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.842926 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.843311 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.843524 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:31.844898 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.846432 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.851520 (+ 5088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.852996 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.853183 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.853404 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.853612 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.853782 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":323,"threads_started":1}
I20260808 08:45:31.857682 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.845864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:42983 (local address 127.0.0.1:57350)
0808 08:45:31.847190 (+ 1326us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:31.847214 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:31.847350 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:31.847992 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:31.847997 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:31.848022 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:31.850562 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.850578 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.852578 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.852584 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.854768 (+ 2184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.854787 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.856741 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.856748 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.856925 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.856959 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:45:31.857068 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:45:31.857274 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"mutex_wait_us":1,"thread_start_us":915,"threads_started":1}
I20260808 08:45:31.857754 14527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.845420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57350 (local address 127.19.242.195:42983)
0808 08:45:31.846145 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.846154 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.847340 (+ 1186us) server_negotiation.cc:407] Connection header received
0808 08:45:31.847530 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.847539 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.847773 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.847987 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:31.850840 (+ 2853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.852382 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.855023 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.856504 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.856726 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.856944 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.857140 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.857308 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":582,"threads_started":1}
I20260808 08:45:31.858256 14015 tablet_service.cc:1467] Processing CreateTablet for tablet a164c13549344137bc24b0b919dd8d58 (DEFAULT_TABLE table=test-table [id=152fbf42a2e04d988ef915c5af8c0925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:31.858997 14199 tablet_service.cc:1467] Processing CreateTablet for tablet a164c13549344137bc24b0b919dd8d58 (DEFAULT_TABLE table=test-table [id=152fbf42a2e04d988ef915c5af8c0925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:31.860105 14015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a164c13549344137bc24b0b919dd8d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:31.860360 14199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a164c13549344137bc24b0b919dd8d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:31.861624 14399 tablet_service.cc:1467] Processing CreateTablet for tablet a164c13549344137bc24b0b919dd8d58 (DEFAULT_TABLE table=test-table [id=152fbf42a2e04d988ef915c5af8c0925]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:31.863291 14399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a164c13549344137bc24b0b919dd8d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:31.872856 14529 tablet_bootstrap.cc:492] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Bootstrap starting.
I20260808 08:45:31.876096 14530 tablet_bootstrap.cc:492] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: Bootstrap starting.
I20260808 08:45:31.878602 14529 tablet_bootstrap.cc:654] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:31.879558 14531 tablet_bootstrap.cc:492] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Bootstrap starting.
I20260808 08:45:31.880081 14530 tablet_bootstrap.cc:654] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:31.880447 14529 log.cc:824] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:31.881491 14530 log.cc:824] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:31.883260 14531 tablet_bootstrap.cc:654] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:31.884459 14529 tablet_bootstrap.cc:492] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: No bootstrap required, opened a new log
I20260808 08:45:31.884462 14531 log.cc:824] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:31.884791 14529 ts_tablet_manager.cc:1397] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260808 08:45:31.885576 14530 tablet_bootstrap.cc:492] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: No bootstrap required, opened a new log
I20260808 08:45:31.885864 14530 ts_tablet_manager.cc:1397] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 08:45:31.887923 14531 tablet_bootstrap.cc:492] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: No bootstrap required, opened a new log
I20260808 08:45:31.888222 14531 ts_tablet_manager.cc:1397] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 08:45:31.896075 14531 raft_consensus.cc:348] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.896656 14531 raft_consensus.cc:374] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:31.896353 14529 raft_consensus.cc:348] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.896766 14531 raft_consensus.cc:729] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f0933e210774a3cbc409cc51d74738d, State: Initialized, Role: FOLLOWER
I20260808 08:45:31.896826 14529 raft_consensus.cc:374] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:31.896934 14529 raft_consensus.cc:729] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe36365bc214c1fb4ab4163847f2357, State: Initialized, Role: FOLLOWER
I20260808 08:45:31.897169 14530 raft_consensus.cc:348] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.897655 14530 raft_consensus.cc:374] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:31.897773 14530 raft_consensus.cc:729] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447d1cea02aa4940bc73f56bff53e90b, State: Initialized, Role: FOLLOWER
I20260808 08:45:31.897646 14531 consensus_queue.cc:260] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.897708 14529 consensus_queue.cc:260] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.898640 14530 consensus_queue.cc:260] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.899911 14292 heartbeater.cc:503] Master 127.19.242.254:43635 was elected leader, sending a full tablet report...
I20260808 08:45:31.900846 14529 ts_tablet_manager.cc:1428] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260808 08:45:31.902824 14530 ts_tablet_manager.cc:1428] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: Time spent starting tablet: real 0.017s user 0.018s sys 0.000s
I20260808 08:45:31.903573 14504 heartbeater.cc:503] Master 127.19.242.254:43635 was elected leader, sending a full tablet report...
I20260808 08:45:31.905164 14531 ts_tablet_manager.cc:1428] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Time spent starting tablet: real 0.017s user 0.008s sys 0.008s
I20260808 08:45:31.933099 14540 raft_consensus.cc:482] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:45:31.933499 14540 raft_consensus.cc:504] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.935451 14540 leader_election.cc:288] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe36365bc214c1fb4ab4163847f2357 (127.19.242.194:43893), 447d1cea02aa4940bc73f56bff53e90b (127.19.242.193:37979)
I20260808 08:45:31.942307 14507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.935901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:43893 (local address 127.19.242.195:46163)
0808 08:45:31.936203 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:31.936224 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:31.936414 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:31.936985 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:31.936990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:31.937030 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:31.937243 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.937254 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.938455 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.938463 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.940085 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.940107 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.941411 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.941418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.941634 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.941662 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:45:31.941788 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 08:45:31.941965 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143}
I20260808 08:45:31.942292 14521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.936291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:46163 (local address 127.19.242.194:43893)
0808 08:45:31.936623 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.936628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.936647 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:45:31.936721 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.936725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.936802 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.936928 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:31.937457 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.938251 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.940315 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.941223 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.941419 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.941514 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.941828 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.941974 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 08:45:31.943490 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.936837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:42799 (local address 127.19.242.193:37979)
0808 08:45:31.937054 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.937062 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.937606 (+ 544us) server_negotiation.cc:407] Connection header received
0808 08:45:31.937840 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.937844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.937910 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.938025 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:31.938692 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.939506 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.941498 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.942408 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.942624 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.942735 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.943140 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.943291 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 08:45:31.943635 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.936514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.19.242.195:42799)
0808 08:45:31.937480 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:31.937497 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:31.937670 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:31.938053 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:31.938059 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:31.938090 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:31.938511 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.938522 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.939712 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.939721 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.941282 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:31.941295 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.942742 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.942749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:31.942955 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.942982 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 08:45:31.943073 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 08:45:31.943174 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":21,"thread_start_us":584,"threads_started":1}
I20260808 08:45:31.943876 14233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a164c13549344137bc24b0b919dd8d58" candidate_uuid: "1f0933e210774a3cbc409cc51d74738d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe36365bc214c1fb4ab4163847f2357" is_pre_election: true
I20260808 08:45:31.944622 14233 raft_consensus.cc:2454] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0933e210774a3cbc409cc51d74738d in term 0.
I20260808 08:45:31.944849 14043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a164c13549344137bc24b0b919dd8d58" candidate_uuid: "1f0933e210774a3cbc409cc51d74738d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447d1cea02aa4940bc73f56bff53e90b" is_pre_election: true
I20260808 08:45:31.945549 14043 raft_consensus.cc:2454] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f0933e210774a3cbc409cc51d74738d in term 0.
I20260808 08:45:31.945516 14326 leader_election.cc:302] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe36365bc214c1fb4ab4163847f2357, 1f0933e210774a3cbc409cc51d74738d; no voters:
W20260808 08:45:31.945787 14117 tablet.cc:2369] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:31.946151 14540 raft_consensus.cc:2781] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:45:31.946338 14540 raft_consensus.cc:482] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:45:31.946491 14540 raft_consensus.cc:3037] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:31.949723 14540 raft_consensus.cc:504] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.950536 14540 leader_election.cc:288] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [CANDIDATE]: Term 1 election: Requested vote from peers 0fe36365bc214c1fb4ab4163847f2357 (127.19.242.194:43893), 447d1cea02aa4940bc73f56bff53e90b (127.19.242.193:37979)
I20260808 08:45:31.951182 14233 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a164c13549344137bc24b0b919dd8d58" candidate_uuid: "1f0933e210774a3cbc409cc51d74738d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe36365bc214c1fb4ab4163847f2357"
I20260808 08:45:31.951210 14043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a164c13549344137bc24b0b919dd8d58" candidate_uuid: "1f0933e210774a3cbc409cc51d74738d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447d1cea02aa4940bc73f56bff53e90b"
I20260808 08:45:31.951453 14233 raft_consensus.cc:3037] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:31.951464 14043 raft_consensus.cc:3037] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:31.954128 14043 raft_consensus.cc:2454] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0933e210774a3cbc409cc51d74738d in term 1.
I20260808 08:45:31.954375 14233 raft_consensus.cc:2454] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f0933e210774a3cbc409cc51d74738d in term 1.
I20260808 08:45:31.954860 14326 leader_election.cc:302] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f0933e210774a3cbc409cc51d74738d, 447d1cea02aa4940bc73f56bff53e90b; no voters:
I20260808 08:45:31.955220 14540 raft_consensus.cc:2781] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:31.955821 14540 raft_consensus.cc:686] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 1 LEADER]: Becoming Leader. State: Replica: 1f0933e210774a3cbc409cc51d74738d, State: Running, Role: LEADER
I20260808 08:45:31.956403 14540 consensus_queue.cc:237] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } }
I20260808 08:45:31.962004 13832 catalog_manager.cc:5495] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f0933e210774a3cbc409cc51d74738d (127.19.242.195). New cstate: current_term: 1 leader_uuid: "1f0933e210774a3cbc409cc51d74738d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f0933e210774a3cbc409cc51d74738d" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 42983 } health_report { overall_health: HEALTHY } } }
W20260808 08:45:31.979574 14293 tablet.cc:2369] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:31.989003 14527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:31.982259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57352 (local address 127.19.242.195:42983)
0808 08:45:31.982559 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:31.982565 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:31.982589 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:45:31.982746 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:31.982750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:31.982852 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:31.983027 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:45:31.983498 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.984389 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.986170 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:31.986683 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:31.986845 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:31.987557 (+ 712us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:45:31.988114 (+ 557us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:45:31.988258 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:31.988553 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 08:45:31.988637 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260808 08:45:31.999405 14233 raft_consensus.cc:1261] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 1 FOLLOWER]: Refusing update from remote peer 1f0933e210774a3cbc409cc51d74738d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:31.999469 14043 raft_consensus.cc:1261] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 1 FOLLOWER]: Refusing update from remote peer 1f0933e210774a3cbc409cc51d74738d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:32.000689 14544 consensus_queue.cc:1035] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe36365bc214c1fb4ab4163847f2357" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:32.001128 14540 consensus_queue.cc:1035] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [LEADER]: Connected to new peer: Peer: permanent_uuid: "447d1cea02aa4940bc73f56bff53e90b" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 37979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:32.016399 14547 mvcc.cc:205] Tried to move back new op lower bound from 7316188086255456256 to 7316188086098604032. Current Snapshot: MvccSnapshot[applied={T|T < 7316188086255456256}]
I20260808 08:45:32.019565 14548 mvcc.cc:205] Tried to move back new op lower bound from 7316188086255456256 to 7316188086098604032. Current Snapshot: MvccSnapshot[applied={T|T < 7316188086255456256}]
I20260808 08:45:32.040367 13829 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:32.040729 13829 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:32.045338 13829 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b331d7453924543b2a3be6412abb3db: Sending DeleteTablet for 3 replicas of tablet a164c13549344137bc24b0b919dd8d58
I20260808 08:45:32.046777 14199 tablet_service.cc:1514] Processing DeleteTablet for tablet a164c13549344137bc24b0b919dd8d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:32 UTC) from {username='slave'} at 127.0.0.1:49810
I20260808 08:45:32.046957 14399 tablet_service.cc:1514] Processing DeleteTablet for tablet a164c13549344137bc24b0b919dd8d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:32 UTC) from {username='slave'} at 127.0.0.1:57350
I20260808 08:45:32.048027 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 13914
I20260808 08:45:32.048062 14015 tablet_service.cc:1514] Processing DeleteTablet for tablet a164c13549344137bc24b0b919dd8d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:32 UTC) from {username='slave'} at 127.0.0.1:51190
I20260808 08:45:32.079442 14561 tablet_replica.cc:330] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: stopping tablet replica
I20260808 08:45:32.080061 14561 raft_consensus.cc:2229] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:45:32.081679 14560 tablet_replica.cc:330] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: stopping tablet replica
I20260808 08:45:32.081916 14563 tablet_replica.cc:330] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: stopping tablet replica
I20260808 08:45:32.082362 14560 raft_consensus.cc:2229] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:32.082368 14563 raft_consensus.cc:2229] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:32.082968 14563 raft_consensus.cc:2258] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:32.082968 14560 raft_consensus.cc:2258] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:32.084360 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.049578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51198 (local address 127.19.242.193:37979)
0808 08:45:32.049813 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:32.049822 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:32.071061 (+ 21239us) server_negotiation.cc:407] Connection header received
0808 08:45:32.073188 (+ 2127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:32.073235 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:32.073390 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:32.073471 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:32.075255 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:32.076442 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:32.079228 (+ 2786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:32.079883 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:32.080006 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:32.082235 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:32.082250 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:32.082270 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:32.083196 (+ 926us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:32.083269 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:32.083302 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:32.083443 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:32.083809 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 08:45:32.083970 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:45:32.081022 14561 raft_consensus.cc:2258] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:32.085711 14108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:32.085794 14560 ts_tablet_manager.cc:1905] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:32.095309 14560 ts_tablet_manager.cc:1918] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:32.095626 14560 log.cc:1196] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/a164c13549344137bc24b0b919dd8d58
I20260808 08:45:32.095638 14561 ts_tablet_manager.cc:1905] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:32.096385 14560 ts_tablet_manager.cc:1939] T a164c13549344137bc24b0b919dd8d58 P 0fe36365bc214c1fb4ab4163847f2357: Deleting consensus metadata
I20260808 08:45:32.098645 13809 catalog_manager.cc:4841] TS 0fe36365bc214c1fb4ab4163847f2357 (127.19.242.194:43893): tablet a164c13549344137bc24b0b919dd8d58 (table test-table [id=152fbf42a2e04d988ef915c5af8c0925]) successfully deleted
I20260808 08:45:32.102447 14561 ts_tablet_manager.cc:1918] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:32.102828 14561 log.cc:1196] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/a164c13549344137bc24b0b919dd8d58
I20260808 08:45:32.103788 14561 ts_tablet_manager.cc:1939] T a164c13549344137bc24b0b919dd8d58 P 1f0933e210774a3cbc409cc51d74738d: Deleting consensus metadata
I20260808 08:45:32.106501 13809 catalog_manager.cc:4841] TS 1f0933e210774a3cbc409cc51d74738d (127.19.242.195:42983): tablet a164c13549344137bc24b0b919dd8d58 (table test-table [id=152fbf42a2e04d988ef915c5af8c0925]) successfully deleted
I20260808 08:45:32.092891 14563 ts_tablet_manager.cc:1905] T a164c13549344137bc24b0b919dd8d58 P 447d1cea02aa4940bc73f56bff53e90b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:32.196775 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 13914
W20260808 08:45:32.222076 13809 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.242.193:37979 (error 108)
I20260808 08:45:32.222373 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 14121
I20260808 08:45:32.224889 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.224272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51204)
0808 08:45:32.224542 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.224684 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260808 08:45:32.225169 13809 catalog_manager.cc:4584] TS 447d1cea02aa4940bc73f56bff53e90b (127.19.242.193:37979): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a164c13549344137bc24b0b919dd8d58: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
I20260808 08:45:32.232288 14521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.223423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49816 (local address 127.19.242.194:43893)
0808 08:45:32.223624 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:32.223631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:32.223725 (+ 94us) server_negotiation.cc:407] Connection header received
0808 08:45:32.223892 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:32.223898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:32.224027 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:32.224173 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:32.224700 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:32.226029 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:32.228053 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:32.228908 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:32.229061 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:32.230416 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:32.230428 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:32.230447 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:32.231328 (+ 881us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:32.231395 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:32.231424 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:32.231554 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:32.231724 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 08:45:32.231864 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:45:32.233150 14285 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:32.279126 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.278417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51210)
0808 08:45:32.278757 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.278902 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260808 08:45:32.280517 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.280048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51226)
0808 08:45:32.280252 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.280348 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 08:45:32.336133 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 14121
I20260808 08:45:32.341794 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.341058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51234)
0808 08:45:32.341410 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.341530 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260808 08:45:32.343339 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.342766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51242)
0808 08:45:32.343044 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.343158 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260808 08:45:32.369910 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 14296
I20260808 08:45:32.378331 14527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.370922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57362 (local address 127.19.242.195:42983)
0808 08:45:32.371165 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:32.371171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:32.371192 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:45:32.371385 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:32.371391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:32.371486 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:32.371605 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:32.372103 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:32.373005 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:32.374415 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:32.375191 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:32.375357 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:32.376749 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:32.376761 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:32.376780 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:32.377450 (+ 670us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:32.377508 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:32.377530 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:32.377672 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:32.377829 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 08:45:32.377939 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 08:45:32.379236 14498 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:32.424712 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.424136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51256)
0808 08:45:32.424431 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.424549 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260808 08:45:32.426007 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.425579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51266)
0808 08:45:32.425813 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.425891 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260808 08:45:32.507252 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 14296
I20260808 08:45:32.538548 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 13787
I20260808 08:45:32.539831 13873 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:32.653057 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:32.652472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:37979 (local address 127.0.0.1:51274)
0808 08:45:32.652691 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:32.652829 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.193:37979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:45:32.653764 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 13787
2026-08-08T08:45:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3217 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:32 dist-test-slave-39l8 krb5kdc[14578](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:32 dist-test-slave-39l8 krb5kdc[14578](info): set up 2 sockets
Aug 08 08:45:32 dist-test-slave-39l8 krb5kdc[14578](info): commencing operation
krb5kdc: starting...
W20260808 08:45:34.040182 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.329s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:45:34 dist-test-slave-39l8 krb5kdc[14578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:45:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:45:34.398912 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46655
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:33333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:46655
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:34.782334 14596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:34.782676 14596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:34.782812 14596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:34.790585 14596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:34.790812 14596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:34.790877 14596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:34.790947 14596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:34.790993 14596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:34.801848 14596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:46655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:34.803411 14596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:34.804812 14596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:34.818224 14604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:34.818281 14601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:34.818322 14602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:34.819097 14596 server_base.cc:1034] running on GCE node
I20260808 08:45:34.820000 14596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:34.821601 14596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:34.822844 14596 hybrid_clock.cc:648] HybridClock initialized: now 1786178734822775 us; error 55 us; skew 500 ppm
I20260808 08:45:34.823300 14596 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:34 dist-test-slave-39l8 krb5kdc[14578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178734, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:34.826763 14596 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:45:34.828608 14596 webserver.cc:460] Webserver started at http://127.19.242.254:32935/ using document root <none> and password file <none>
I20260808 08:45:34.829409 14596 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:34.829577 14596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:34.829924 14596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:34.833336 14596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "cfad7047fb8749168c8650357432b06c"
format_stamp: "Formatted at 2026-08-08 08:45:34 on dist-test-slave-39l8"
server_key: "594259777fd9740de9c2e2c5a01a5ca8"
server_key_iv: "1cdcbbe43a2177821214eb45b364a99d"
server_key_version: "encryptionkey@0"
I20260808 08:45:34.834218 14596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "cfad7047fb8749168c8650357432b06c"
format_stamp: "Formatted at 2026-08-08 08:45:34 on dist-test-slave-39l8"
server_key: "594259777fd9740de9c2e2c5a01a5ca8"
server_key_iv: "1cdcbbe43a2177821214eb45b364a99d"
server_key_version: "encryptionkey@0"
I20260808 08:45:34.840221 14596 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 08:45:34.844312 14614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:34.845942 14596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:45:34.846131 14596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "cfad7047fb8749168c8650357432b06c"
format_stamp: "Formatted at 2026-08-08 08:45:34 on dist-test-slave-39l8"
server_key: "594259777fd9740de9c2e2c5a01a5ca8"
server_key_iv: "1cdcbbe43a2177821214eb45b364a99d"
server_key_version: "encryptionkey@0"
I20260808 08:45:34.846331 14596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:34.863929 14596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:34.869164 14596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:34.869448 14596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:34.890440 14596 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:46655
I20260808 08:45:34.890465 14689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:46655 every 8 connection(s)
I20260808 08:45:34.891997 14596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:34.895171 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 14596
I20260808 08:45:34.895385 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:34.895879 20427 external_mini_cluster.cc:1428] Setting key 7368735d55f35e27c3e8c8ef8a307682
I20260808 08:45:34.896315 14692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:34.912143 14692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c: Bootstrap starting.
Aug 08 08:45:34 dist-test-slave-39l8 krb5kdc[14578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:34.916566 14692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:34.918181 14692 log.cc:824] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:34.922554 14692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c: No bootstrap required, opened a new log
I20260808 08:45:34.924743 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:34.897889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34104 (local address 127.19.242.254:46655)
0808 08:45:34.898818 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:34.898841 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:34.898897 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:45:34.901606 (+ 2709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:34.901641 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:34.902247 (+ 606us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:34.902803 (+ 556us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:34.904445 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:34.906480 (+ 2035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:34.908131 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:34.909323 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:34.909539 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:34.914624 (+ 5085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:34.914636 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:34.914658 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:34.914742 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:34.919251 (+ 4509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:34.920388 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:34.920398 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:34.920415 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:34.920675 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:34.921113 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:34.921117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:34.921120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:34.921903 (+ 783us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:34.922212 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:34.922686 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 08:45:34.923262 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":367,"threads_started":1}
I20260808 08:45:34.932150 14692 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfad7047fb8749168c8650357432b06c" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46655 } }
I20260808 08:45:34.932600 14692 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:34.932740 14692 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfad7047fb8749168c8650357432b06c, State: Initialized, Role: FOLLOWER
I20260808 08:45:34.933432 14692 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfad7047fb8749168c8650357432b06c" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46655 } }
I20260808 08:45:34.933677 14692 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:34.933827 14692 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:34.934002 14692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:34.936605 14692 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfad7047fb8749168c8650357432b06c" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46655 } }
I20260808 08:45:34.937295 14692 leader_election.cc:302] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfad7047fb8749168c8650357432b06c; no voters:
I20260808 08:45:34.938005 14692 leader_election.cc:288] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:34.938220 14697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:34.939092 14697 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [term 1 LEADER]: Becoming Leader. State: Replica: cfad7047fb8749168c8650357432b06c, State: Running, Role: LEADER
I20260808 08:45:34.939812 14697 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfad7047fb8749168c8650357432b06c" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46655 } }
I20260808 08:45:34.940502 14692 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:34.943168 14700 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfad7047fb8749168c8650357432b06c. Latest consensus state: current_term: 1 leader_uuid: "cfad7047fb8749168c8650357432b06c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfad7047fb8749168c8650357432b06c" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46655 } } }
I20260808 08:45:34.943687 14700 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:34.943514 14698 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfad7047fb8749168c8650357432b06c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfad7047fb8749168c8650357432b06c" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46655 } } }
I20260808 08:45:34.943823 14698 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:34.945919 14704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:34.952720 14704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:34.964138 14704 catalog_manager.cc:1347] Generated new cluster ID: 9b070e20a7bb4f74be2f6b70959c5409
I20260808 08:45:34.964316 14704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:34.982602 14704 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:34.984110 14704 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:34.996611 14704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c: Generated new TSK 0
I20260808 08:45:34.997654 14704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:45:35.078960 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46655
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:33333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:35.454023 14724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:35.454401 14724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:35.454569 14724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:35.462183 14724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:35.462373 14724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:35.462563 14724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:45:35.473001 14724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:35.474538 14724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:35.476003 14724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:35.490945 14733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:35.490976 14734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:35.490886 14738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:35.492516 14724 server_base.cc:1034] running on GCE node
I20260808 08:45:35.493307 14724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:35.494990 14724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:35.496292 14724 hybrid_clock.cc:648] HybridClock initialized: now 1786178735496245 us; error 73 us; skew 500 ppm
I20260808 08:45:35.496701 14724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:35 dist-test-slave-39l8 krb5kdc[14578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178735, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:35.500315 14724 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:45:35.502067 14724 webserver.cc:460] Webserver started at http://127.19.242.193:40579/ using document root <none> and password file <none>
I20260808 08:45:35.502918 14724 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:35.503077 14724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:35.503430 14724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:35.506861 14724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "2528c1fec87744459b112e2bd685ae1c"
format_stamp: "Formatted at 2026-08-08 08:45:35 on dist-test-slave-39l8"
server_key: "2720bb0c160fec0fde8b108b17a82655"
server_key_iv: "4207aaf87bbe3cfc2d8c921b76e168ae"
server_key_version: "encryptionkey@0"
I20260808 08:45:35.507742 14724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "2528c1fec87744459b112e2bd685ae1c"
format_stamp: "Formatted at 2026-08-08 08:45:35 on dist-test-slave-39l8"
server_key: "2720bb0c160fec0fde8b108b17a82655"
server_key_iv: "4207aaf87bbe3cfc2d8c921b76e168ae"
server_key_version: "encryptionkey@0"
I20260808 08:45:35.513860 14724 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:45:35.518060 14749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:35.519759 14724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:45:35.519992 14724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "2528c1fec87744459b112e2bd685ae1c"
format_stamp: "Formatted at 2026-08-08 08:45:35 on dist-test-slave-39l8"
server_key: "2720bb0c160fec0fde8b108b17a82655"
server_key_iv: "4207aaf87bbe3cfc2d8c921b76e168ae"
server_key_version: "encryptionkey@0"
I20260808 08:45:35.520241 14724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:35.538101 14724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:35.543423 14724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:35.543761 14724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:35.544881 14724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:35.546494 14724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:35.546610 14724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:35.546808 14724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:35.546882 14724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:35.581818 14724 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:45927
I20260808 08:45:35.581868 14912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:45927 every 8 connection(s)
I20260808 08:45:35.583249 14724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:45:35.588449 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 14724
I20260808 08:45:35.588693 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:45:35.589166 20427 external_mini_cluster.cc:1428] Setting key 0d0a91263c25c625f4a13aa13d820c7f
Aug 08 08:45:35 dist-test-slave-39l8 krb5kdc[14578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178735, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:35.608650 14919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:35.586298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:33979 (local address 127.19.242.254:46655)
0808 08:45:35.586838 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:35.586843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:35.587813 (+ 970us) server_negotiation.cc:407] Connection header received
0808 08:45:35.590149 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:35.590156 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:35.590254 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:35.590397 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:35.592590 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:35.593911 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:35.595815 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:35.596581 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:35.596750 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:35.600617 (+ 3867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:35.600627 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:35.600635 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:35.600688 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:35.604784 (+ 4096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:35.605805 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:35.605813 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:35.605819 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:35.605994 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:35.606574 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:35.606582 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:35.606588 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:35.606956 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:35.607134 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:35.607967 (+ 833us) server_negotiation.cc:299] Negotiation successful
0808 08:45:35.608232 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":239,"threads_started":1}
I20260808 08:45:35.609789 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:35.586882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:46655 (local address 127.19.242.193:33979)
0808 08:45:35.587634 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:35.587674 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:35.589573 (+ 1899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:35.590786 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:35.590800 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:35.591686 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:35.592378 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:35.592398 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:35.594103 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:35.594108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:35.595627 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:35.595643 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:35.596845 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:35.596850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:35.597072 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:35.597857 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:35.597882 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:35.600296 (+ 2414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:35.605019 (+ 4723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:35.605029 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:35.605046 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:35.605611 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:35.606164 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:35.606168 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:35.606170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:35.606426 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:35.607113 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:35.607122 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:35.607550 (+ 428us) client_negotiation.cc:769] Sending connection context
0808 08:45:35.607852 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 08:45:35.608483 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":278,"threads_started":1}
I20260808 08:45:35.611891 14915 heartbeater.cc:347] Connected to a master server at 127.19.242.254:46655
I20260808 08:45:35.612282 14915 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:35.613118 14915 heartbeater.cc:511] Master 127.19.242.254:46655 requested a full tablet report, sending...
I20260808 08:45:35.615888 14637 ts_manager.cc:194] Registered new tserver with Master: 2528c1fec87744459b112e2bd685ae1c (127.19.242.193:45927)
I20260808 08:45:35.618263 14637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:33979
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:45:35.667656 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46655
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:33333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:36.036712 14925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:36.037063 14925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:36.037166 14925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:36.045248 14925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:36.045384 14925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:36.045502 14925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:45:36.056067 14925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:36.057432 14925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:36.058770 14925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:36.073196 14931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:36.073151 14932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:36.073107 14939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:36.074625 14925 server_base.cc:1034] running on GCE node
I20260808 08:45:36.075421 14925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:36.076524 14925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:36.077760 14925 hybrid_clock.cc:648] HybridClock initialized: now 1786178736077705 us; error 53 us; skew 500 ppm
I20260808 08:45:36.078130 14925 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:36 dist-test-slave-39l8 krb5kdc[14578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178736, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:36.081832 14925 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:45:36.083832 14925 webserver.cc:460] Webserver started at http://127.19.242.194:35575/ using document root <none> and password file <none>
I20260808 08:45:36.084661 14925 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:36.084831 14925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:36.085207 14925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:36.088640 14925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "c0f44a928b47451385991be6d767ec76"
format_stamp: "Formatted at 2026-08-08 08:45:36 on dist-test-slave-39l8"
server_key: "8fff68902ded9609d8f3174a8deba7a0"
server_key_iv: "838d916d51b34b566c568879a1e66eb3"
server_key_version: "encryptionkey@0"
I20260808 08:45:36.089579 14925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "c0f44a928b47451385991be6d767ec76"
format_stamp: "Formatted at 2026-08-08 08:45:36 on dist-test-slave-39l8"
server_key: "8fff68902ded9609d8f3174a8deba7a0"
server_key_iv: "838d916d51b34b566c568879a1e66eb3"
server_key_version: "encryptionkey@0"
I20260808 08:45:36.095993 14925 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 08:45:36.100492 14948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:36.102144 14925 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:45:36.102382 14925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "c0f44a928b47451385991be6d767ec76"
format_stamp: "Formatted at 2026-08-08 08:45:36 on dist-test-slave-39l8"
server_key: "8fff68902ded9609d8f3174a8deba7a0"
server_key_iv: "838d916d51b34b566c568879a1e66eb3"
server_key_version: "encryptionkey@0"
I20260808 08:45:36.102639 14925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:36.135548 14925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:36.140555 14925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:36.140892 14925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:36.142146 14925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:36.143910 14925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:36.144024 14925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:36.144186 14925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:36.144269 14925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:36.185333 14925 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:44585
I20260808 08:45:36.185436 15126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:44585 every 8 connection(s)
I20260808 08:45:36.186879 14925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:45:36.194855 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 14925
I20260808 08:45:36.195084 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:45:36.195555 20427 external_mini_cluster.cc:1428] Setting key a5d542ba07c7bc23f2d93d60a7c18d8a
Aug 08 08:45:36 dist-test-slave-39l8 krb5kdc[14578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178736, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:36.212181 15130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.189804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:41913 (local address 127.19.242.254:46655)
0808 08:45:36.190271 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:36.190275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:36.191480 (+ 1205us) server_negotiation.cc:407] Connection header received
0808 08:45:36.193507 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:36.193512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:36.193619 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:36.193735 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:36.195775 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.196726 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.199187 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.199649 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.199767 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.204792 (+ 5025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:36.204798 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:36.204801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:36.204846 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:36.208088 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:36.209030 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:36.209035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:36.209038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:36.209182 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:36.209700 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:36.209704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:36.209706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:36.210123 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:36.210284 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:36.211402 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0808 08:45:36.211694 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":232,"threads_started":1}
I20260808 08:45:36.213474 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.190381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:46655 (local address 127.19.242.194:41913)
0808 08:45:36.191279 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:36.191322 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:36.193153 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:36.194002 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:36.194012 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:36.194671 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:36.195524 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.195553 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.196913 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.196918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.198962 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.198986 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.199937 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.199948 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.200346 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.201307 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:36.201344 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:36.204426 (+ 3082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:36.208279 (+ 3853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:36.208295 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:36.208310 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:36.208856 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:36.209309 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:36.209317 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:36.209325 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:36.209546 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:36.210296 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:36.210309 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:36.210910 (+ 601us) client_negotiation.cc:769] Sending connection context
0808 08:45:36.211286 (+ 376us) client_negotiation.cc:240] Negotiation successful
0808 08:45:36.211955 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":383,"threads_started":1}
I20260808 08:45:36.215350 15128 heartbeater.cc:347] Connected to a master server at 127.19.242.254:46655
I20260808 08:45:36.215710 15128 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:36.216537 15128 heartbeater.cc:511] Master 127.19.242.254:46655 requested a full tablet report, sending...
I20260808 08:45:36.218367 14637 ts_manager.cc:194] Registered new tserver with Master: c0f44a928b47451385991be6d767ec76 (127.19.242.194:44585)
I20260808 08:45:36.219802 14637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:41913
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:45:36.275192 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46655
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:33333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:45:36.622076 14915 heartbeater.cc:503] Master 127.19.242.254:46655 was elected leader, sending a full tablet report...
W20260808 08:45:36.649879 15134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:36.650259 15134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:36.650452 15134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:36.658192 15134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:36.658389 15134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:36.658562 15134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:45:36.668951 15134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:33333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:46655
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:36.670423 15134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:36.671902 15134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:36.686600 15147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:36.686651 15143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:36.686677 15144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:36.687490 15134 server_base.cc:1034] running on GCE node
I20260808 08:45:36.688279 15134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:36.689517 15134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:36.690833 15134 hybrid_clock.cc:648] HybridClock initialized: now 1786178736690778 us; error 51 us; skew 500 ppm
I20260808 08:45:36.691216 15134 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:36 dist-test-slave-39l8 krb5kdc[14578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178736, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:36.694833 15134 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:45:36.696542 15134 webserver.cc:460] Webserver started at http://127.19.242.195:33629/ using document root <none> and password file <none>
I20260808 08:45:36.697315 15134 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:36.697476 15134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:36.697829 15134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:36.701161 15134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "5378205cafe342d2a033dd3d841ed194"
format_stamp: "Formatted at 2026-08-08 08:45:36 on dist-test-slave-39l8"
server_key: "3b58ba1e859ee84396cc71363b6202db"
server_key_iv: "9700d2f3d8aebd5bd985d58fd8f727f1"
server_key_version: "encryptionkey@0"
I20260808 08:45:36.702025 15134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "5378205cafe342d2a033dd3d841ed194"
format_stamp: "Formatted at 2026-08-08 08:45:36 on dist-test-slave-39l8"
server_key: "3b58ba1e859ee84396cc71363b6202db"
server_key_iv: "9700d2f3d8aebd5bd985d58fd8f727f1"
server_key_version: "encryptionkey@0"
I20260808 08:45:36.708173 15134 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 08:45:36.712903 15157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:36.714681 15134 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:45:36.714948 15134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "5378205cafe342d2a033dd3d841ed194"
format_stamp: "Formatted at 2026-08-08 08:45:36 on dist-test-slave-39l8"
server_key: "3b58ba1e859ee84396cc71363b6202db"
server_key_iv: "9700d2f3d8aebd5bd985d58fd8f727f1"
server_key_version: "encryptionkey@0"
I20260808 08:45:36.715174 15134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:36.736244 15134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:36.741436 15134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:36.741781 15134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:36.743027 15134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:36.744572 15134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:36.744688 15134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:36.744854 15134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:36.744937 15134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:36.782382 15134 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:33539
I20260808 08:45:36.782440 15338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:33539 every 8 connection(s)
I20260808 08:45:36.783831 15134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:45:36.791767 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 15134
I20260808 08:45:36.792018 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:45:36.792613 20427 external_mini_cluster.cc:1428] Setting key 11729034afb4c269bce65b1c114828f1
Aug 08 08:45:36 dist-test-slave-39l8 krb5kdc[14578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178736, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:36.806636 15342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.786767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:48611 (local address 127.19.242.254:46655)
0808 08:45:36.787213 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:36.787218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:36.788308 (+ 1090us) server_negotiation.cc:407] Connection header received
0808 08:45:36.790227 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:36.790233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:36.790335 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:36.790462 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:36.792640 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.793583 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.795699 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.796208 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.796316 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.800219 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:36.800224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:36.800228 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:36.800266 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:36.803216 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:36.804046 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:36.804051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:36.804053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:36.804200 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:36.804689 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:36.804693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:36.804696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:36.804997 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:36.805136 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:36.805909 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 08:45:36.806217 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":208,"threads_started":1}
I20260808 08:45:36.807881 15344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.787353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:46655 (local address 127.19.242.195:48611)
0808 08:45:36.788125 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:36.788182 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:36.789920 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:36.790777 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:36.790786 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:36.791445 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:36.792402 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.792436 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.793774 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.793779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.795515 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.795529 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.796436 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.796441 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.796653 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.797386 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:36.797415 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:36.799928 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:36.803389 (+ 3461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:36.803397 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:36.803414 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:36.803904 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:36.804309 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:36.804313 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:36.804315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:36.804516 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:36.805118 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:36.805125 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:36.805491 (+ 366us) client_negotiation.cc:769] Sending connection context
0808 08:45:36.805764 (+ 273us) client_negotiation.cc:240] Negotiation successful
0808 08:45:36.806262 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":324,"threads_started":1}
I20260808 08:45:36.809422 15340 heartbeater.cc:347] Connected to a master server at 127.19.242.254:46655
I20260808 08:45:36.809787 15340 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:36.810609 15340 heartbeater.cc:511] Master 127.19.242.254:46655 requested a full tablet report, sending...
I20260808 08:45:36.812281 14637 ts_manager.cc:194] Registered new tserver with Master: 5378205cafe342d2a033dd3d841ed194 (127.19.242.195:33539)
I20260808 08:45:36.813118 14637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:48611
I20260808 08:45:36.822947 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:45:36.845299 15342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.828092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34112 (local address 127.19.242.254:46655)
0808 08:45:36.828309 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:36.828315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:36.828795 (+ 480us) server_negotiation.cc:407] Connection header received
0808 08:45:36.828956 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:36.828961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:36.829053 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:36.829186 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:36.831121 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.831934 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.833678 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.834193 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.834318 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.837958 (+ 3640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:36.837965 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:36.837968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:36.838077 (+ 109us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:36.841386 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:36.842485 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:36.842489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:36.842492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:36.842654 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:36.843332 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:36.843336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:36.843338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:36.843759 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:36.844010 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:36.844617 (+ 607us) server_negotiation.cc:299] Negotiation successful
0808 08:45:36.844814 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:45:36.850386 14637 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34112:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:45:36.857641 14637 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:45:36.897202 15363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.871563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45882 (local address 127.19.242.193:45927)
0808 08:45:36.886561 (+ 14998us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:36.886571 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:36.886604 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:45:36.887549 (+ 945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:36.887559 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:36.887894 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:36.888133 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:36.889046 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.890697 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.893785 (+ 3088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.895417 (+ 1632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.895630 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.895832 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:36.896643 (+ 811us) server_negotiation.cc:299] Negotiation successful
0808 08:45:36.896860 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14806,"thread_start_us":15256,"threads_started":1}
I20260808 08:45:36.897277 15364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.871868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33539 (local address 127.0.0.1:44096)
0808 08:45:36.887226 (+ 15358us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:36.887258 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:36.887392 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:36.888474 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:36.888479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:36.888509 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:36.889140 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.889162 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.891349 (+ 2187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.891354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.893690 (+ 2336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.893705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.896154 (+ 2449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.896162 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.896391 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.896433 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 08:45:36.896519 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 08:45:36.896791 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15194,"mutex_wait_us":35,"thread_start_us":11569,"threads_started":1}
I20260808 08:45:36.898068 15367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.871274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:45927 (local address 127.0.0.1:45882)
0808 08:45:36.884063 (+ 12789us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:36.884145 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:36.884447 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:36.888184 (+ 3737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:36.888192 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:36.888224 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:36.888799 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.888812 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.890895 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.890901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.893545 (+ 2644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.893562 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.895987 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.895994 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.896276 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.896337 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 08:45:36.896479 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:45:36.897550 (+ 1071us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12347,"mutex_wait_us":862,"thread_start_us":13834,"threads_started":1}
I20260808 08:45:36.899192 15369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.873113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44096 (local address 127.19.242.195:33539)
0808 08:45:36.887775 (+ 14662us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:36.887788 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:36.887832 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:45:36.887942 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:36.887949 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:36.888219 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:36.888449 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:36.889444 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.891147 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.893922 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.895610 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.895813 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.895988 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:36.898572 (+ 2584us) server_negotiation.cc:299] Negotiation successful
0808 08:45:36.898795 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14446,"thread_start_us":14260,"threads_started":1}
I20260808 08:45:36.900589 15360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.871635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:44585 (local address 127.0.0.1:45654)
0808 08:45:36.884854 (+ 13219us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:36.884879 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:36.885019 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:36.888789 (+ 3770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:36.888794 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:36.888820 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:36.889362 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.889377 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.892426 (+ 3049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.892432 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.896257 (+ 3825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:36.896273 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.899735 (+ 3462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.899742 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:36.899922 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.899957 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:45:36.900047 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 08:45:36.900187 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13011,"mutex_wait_us":7,"thread_start_us":15271,"threads_started":1}
I20260808 08:45:36.901422 15368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:36.872567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45654 (local address 127.19.242.194:44585)
0808 08:45:36.888109 (+ 15542us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:36.888118 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:36.888149 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:45:36.888256 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:36.888264 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:36.888477 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:36.889561 (+ 1084us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:36.890566 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.892190 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.896489 (+ 4299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:36.899190 (+ 2701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:36.899379 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:36.899565 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:36.900910 (+ 1345us) server_negotiation.cc:299] Negotiation successful
0808 08:45:36.901096 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15362,"thread_start_us":15203,"threads_started":1}
I20260808 08:45:36.903376 15238 tablet_service.cc:1467] Processing CreateTablet for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 (DEFAULT_TABLE table=test-table [id=8ea8e647fc5c4b1ba1df0cb824d2bf82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:36.903282 14822 tablet_service.cc:1467] Processing CreateTablet for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 (DEFAULT_TABLE table=test-table [id=8ea8e647fc5c4b1ba1df0cb824d2bf82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:36.905296 15238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:36.905452 14822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:36.905019 15027 tablet_service.cc:1467] Processing CreateTablet for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 (DEFAULT_TABLE table=test-table [id=8ea8e647fc5c4b1ba1df0cb824d2bf82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:36.906420 15027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:36.920568 15370 tablet_bootstrap.cc:492] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Bootstrap starting.
I20260808 08:45:36.922890 15371 tablet_bootstrap.cc:492] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Bootstrap starting.
I20260808 08:45:36.924813 15372 tablet_bootstrap.cc:492] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Bootstrap starting.
I20260808 08:45:36.925874 15370 tablet_bootstrap.cc:654] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:36.926795 15371 tablet_bootstrap.cc:654] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:36.927528 15370 log.cc:824] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:36.928109 15371 log.cc:824] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:36.928592 15372 tablet_bootstrap.cc:654] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:36.929908 15372 log.cc:824] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:36.931313 15370 tablet_bootstrap.cc:492] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: No bootstrap required, opened a new log
I20260808 08:45:36.931460 15371 tablet_bootstrap.cc:492] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: No bootstrap required, opened a new log
I20260808 08:45:36.931659 15370 ts_tablet_manager.cc:1397] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260808 08:45:36.931782 15371 ts_tablet_manager.cc:1397] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260808 08:45:36.933351 15372 tablet_bootstrap.cc:492] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: No bootstrap required, opened a new log
I20260808 08:45:36.933663 15372 ts_tablet_manager.cc:1397] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 08:45:36.940109 15370 raft_consensus.cc:348] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:36.940662 15370 raft_consensus.cc:374] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:36.940797 15370 raft_consensus.cc:729] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f44a928b47451385991be6d767ec76, State: Initialized, Role: FOLLOWER
I20260808 08:45:36.941548 15370 consensus_queue.cc:260] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:36.942867 15128 heartbeater.cc:503] Master 127.19.242.254:46655 was elected leader, sending a full tablet report...
I20260808 08:45:36.943660 15370 ts_tablet_manager.cc:1428] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 08:45:36.943538 15371 raft_consensus.cc:348] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:36.944041 15371 raft_consensus.cc:374] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:36.944154 15371 raft_consensus.cc:729] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5378205cafe342d2a033dd3d841ed194, State: Initialized, Role: FOLLOWER
I20260808 08:45:36.944883 15371 consensus_queue.cc:260] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:36.945005 15372 raft_consensus.cc:348] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:36.945667 15372 raft_consensus.cc:374] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:36.945804 15372 raft_consensus.cc:729] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2528c1fec87744459b112e2bd685ae1c, State: Initialized, Role: FOLLOWER
I20260808 08:45:36.946791 15372 consensus_queue.cc:260] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:36.949740 15372 ts_tablet_manager.cc:1428] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
I20260808 08:45:36.950908 15340 heartbeater.cc:503] Master 127.19.242.254:46655 was elected leader, sending a full tablet report...
I20260808 08:45:36.951704 15371 ts_tablet_manager.cc:1428] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Time spent starting tablet: real 0.020s user 0.017s sys 0.003s
W20260808 08:45:37.035710 15341 tablet.cc:2369] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:45:37.086635 14916 tablet.cc:2369] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:37.172636 15384 raft_consensus.cc:482] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:45:37.173048 15384 raft_consensus.cc:504] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:37.175367 15384 leader_election.cc:288] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f44a928b47451385991be6d767ec76 (127.19.242.194:44585), 5378205cafe342d2a033dd3d841ed194 (127.19.242.195:33539)
I20260808 08:45:37.183113 15369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.175984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:47833 (local address 127.19.242.195:33539)
0808 08:45:37.176258 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:37.176268 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:37.177347 (+ 1079us) server_negotiation.cc:407] Connection header received
0808 08:45:37.177630 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:37.177634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:37.177700 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:37.177787 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:37.178405 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.179289 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.181246 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.182035 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.182224 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.182312 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:37.182639 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 08:45:37.182823 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:45:37.183174 15368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.176271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:60315 (local address 127.19.242.194:44585)
0808 08:45:37.176522 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:37.176532 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:37.177147 (+ 615us) server_negotiation.cc:407] Connection header received
0808 08:45:37.177362 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:37.177369 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:37.177456 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:37.177551 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:37.178540 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.179376 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.181289 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.182118 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.182324 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.182407 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:37.182753 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 08:45:37.182889 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:45:37.183300 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.176352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:33539 (local address 127.19.242.193:47833)
0808 08:45:37.177208 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:37.177230 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:37.177451 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:37.177824 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:37.177827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:37.177856 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:37.178204 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:37.178216 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.179428 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.179435 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:37.181065 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:37.181083 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.182281 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.182288 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:37.182465 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.182491 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:45:37.182609 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:45:37.182808 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"mutex_wait_us":64,"thread_start_us":480,"threads_started":1}
I20260808 08:45:37.183796 15385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.175846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:44585 (local address 127.19.242.193:60315)
0808 08:45:37.176981 (+ 1135us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:37.177002 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:37.177208 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:37.177950 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:37.177953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:37.177989 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:37.178376 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:37.178386 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.179551 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.179556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:37.181110 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:37.181125 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.182370 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.182377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:37.182536 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.182560 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:45:37.182670 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:45:37.182859 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":32,"thread_start_us":660,"threads_started":1}
I20260808 08:45:37.184582 15265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6db4f1b40b5e4a7ba2897cd79e46bdb1" candidate_uuid: "2528c1fec87744459b112e2bd685ae1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5378205cafe342d2a033dd3d841ed194" is_pre_election: true
I20260808 08:45:37.184964 15056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6db4f1b40b5e4a7ba2897cd79e46bdb1" candidate_uuid: "2528c1fec87744459b112e2bd685ae1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f44a928b47451385991be6d767ec76" is_pre_election: true
I20260808 08:45:37.185215 15265 raft_consensus.cc:2454] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2528c1fec87744459b112e2bd685ae1c in term 0.
I20260808 08:45:37.185523 15056 raft_consensus.cc:2454] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2528c1fec87744459b112e2bd685ae1c in term 0.
I20260808 08:45:37.186041 14755 leader_election.cc:302] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2528c1fec87744459b112e2bd685ae1c, 5378205cafe342d2a033dd3d841ed194; no voters:
I20260808 08:45:37.186528 15384 raft_consensus.cc:2781] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:45:37.186697 15384 raft_consensus.cc:482] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:45:37.186857 15384 raft_consensus.cc:3037] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:37.189141 15384 raft_consensus.cc:504] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
W20260808 08:45:37.189255 15129 tablet.cc:2369] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:37.189893 15384 leader_election.cc:288] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [CANDIDATE]: Term 1 election: Requested vote from peers c0f44a928b47451385991be6d767ec76 (127.19.242.194:44585), 5378205cafe342d2a033dd3d841ed194 (127.19.242.195:33539)
I20260808 08:45:37.190426 15056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6db4f1b40b5e4a7ba2897cd79e46bdb1" candidate_uuid: "2528c1fec87744459b112e2bd685ae1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f44a928b47451385991be6d767ec76"
I20260808 08:45:37.190681 15056 raft_consensus.cc:3037] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:37.190649 15265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6db4f1b40b5e4a7ba2897cd79e46bdb1" candidate_uuid: "2528c1fec87744459b112e2bd685ae1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5378205cafe342d2a033dd3d841ed194"
I20260808 08:45:37.190891 15265 raft_consensus.cc:3037] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:37.193863 15056 raft_consensus.cc:2454] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2528c1fec87744459b112e2bd685ae1c in term 1.
I20260808 08:45:37.194347 14756 leader_election.cc:302] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2528c1fec87744459b112e2bd685ae1c, c0f44a928b47451385991be6d767ec76; no voters:
I20260808 08:45:37.194687 15384 raft_consensus.cc:2781] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:37.194957 15265 raft_consensus.cc:2454] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2528c1fec87744459b112e2bd685ae1c in term 1.
I20260808 08:45:37.195420 15384 raft_consensus.cc:686] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 1 LEADER]: Becoming Leader. State: Replica: 2528c1fec87744459b112e2bd685ae1c, State: Running, Role: LEADER
I20260808 08:45:37.196094 15384 consensus_queue.cc:237] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } }
I20260808 08:45:37.201099 14636 catalog_manager.cc:5495] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 2528c1fec87744459b112e2bd685ae1c (127.19.242.193). New cstate: current_term: 1 leader_uuid: "2528c1fec87744459b112e2bd685ae1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2528c1fec87744459b112e2bd685ae1c" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 } health_report { overall_health: UNKNOWN } } }
I20260808 08:45:37.280107 15363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.274258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45886 (local address 127.19.242.193:45927)
0808 08:45:37.274446 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:37.274450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:37.274470 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:45:37.274660 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:37.274664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:37.274829 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:37.274973 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:45:37.275439 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.276234 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.277685 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.278090 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.278237 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.278908 (+ 671us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:45:37.279487 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:45:37.279626 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:37.279850 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 08:45:37.279895 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:45:37.289299 15056 raft_consensus.cc:1261] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 1 FOLLOWER]: Refusing update from remote peer 2528c1fec87744459b112e2bd685ae1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:37.289312 15265 raft_consensus.cc:1261] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 1 FOLLOWER]: Refusing update from remote peer 2528c1fec87744459b112e2bd685ae1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:37.290452 15384 consensus_queue.cc:1035] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5378205cafe342d2a033dd3d841ed194" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 33539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:37.290845 15389 consensus_queue.cc:1035] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f44a928b47451385991be6d767ec76" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:37.304145 15392 mvcc.cc:205] Tried to move back new op lower bound from 7316188107925422080 to 7316188107559272448. Current Snapshot: MvccSnapshot[applied={T|T < 7316188107925422080}]
I20260808 08:45:37.305990 15394 mvcc.cc:205] Tried to move back new op lower bound from 7316188107925422080 to 7316188107559272448. Current Snapshot: MvccSnapshot[applied={T|T < 7316188107925422080}]
I20260808 08:45:37.320879 14637 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:37.321241 14637 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34112:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:37.325778 14637 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfad7047fb8749168c8650357432b06c: Sending DeleteTablet for 3 replicas of tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1
I20260808 08:45:37.327453 15238 tablet_service.cc:1514] Processing DeleteTablet for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:37 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:44096
I20260808 08:45:37.327592 14822 tablet_service.cc:1514] Processing DeleteTablet for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:37 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:45882
I20260808 08:45:37.327584 15027 tablet_service.cc:1514] Processing DeleteTablet for tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:37 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:45654
I20260808 08:45:37.330634 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 14724
I20260808 08:45:37.339015 15410 tablet_replica.cc:330] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: stopping tablet replica
I20260808 08:45:37.339668 15410 raft_consensus.cc:2229] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:37.340360 15410 raft_consensus.cc:2258] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:37.342762 15405 tablet_replica.cc:330] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: stopping tablet replica
I20260808 08:45:37.343242 15405 raft_consensus.cc:2229] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:37.343344 15410 ts_tablet_manager.cc:1905] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:37.343741 15405 raft_consensus.cc:2258] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:37.346557 15405 ts_tablet_manager.cc:1905] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:37.346829 15406 tablet_replica.cc:330] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: stopping tablet replica
I20260808 08:45:37.347307 15406 raft_consensus.cc:2229] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:45:37.348160 15406 raft_consensus.cc:2258] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:37.351001 15406 ts_tablet_manager.cc:1905] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:45:37 dist-test-slave-39l8 krb5kdc[14578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:45:37.354660 15405 ts_tablet_manager.cc:1918] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:37.354897 15405 log.cc:1196] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/6db4f1b40b5e4a7ba2897cd79e46bdb1
I20260808 08:45:37.355520 15405 ts_tablet_manager.cc:1939] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 5378205cafe342d2a033dd3d841ed194: Deleting consensus metadata
I20260808 08:45:37.357759 14618 catalog_manager.cc:4841] TS 5378205cafe342d2a033dd3d841ed194 (127.19.242.195:33539): tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 (table test-table [id=8ea8e647fc5c4b1ba1df0cb824d2bf82]) successfully deleted
I20260808 08:45:37.358901 15410 ts_tablet_manager.cc:1918] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:37.359114 15410 log.cc:1196] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/6db4f1b40b5e4a7ba2897cd79e46bdb1
I20260808 08:45:37.359323 15406 ts_tablet_manager.cc:1918] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:37.359565 15406 log.cc:1196] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/6db4f1b40b5e4a7ba2897cd79e46bdb1
I20260808 08:45:37.359764 15410 ts_tablet_manager.cc:1939] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P c0f44a928b47451385991be6d767ec76: Deleting consensus metadata
I20260808 08:45:37.360164 15406 ts_tablet_manager.cc:1939] T 6db4f1b40b5e4a7ba2897cd79e46bdb1 P 2528c1fec87744459b112e2bd685ae1c: Deleting consensus metadata
I20260808 08:45:37.361866 14615 catalog_manager.cc:4841] TS 2528c1fec87744459b112e2bd685ae1c (127.19.242.193:45927): tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 (table test-table [id=8ea8e647fc5c4b1ba1df0cb824d2bf82]) successfully deleted
I20260808 08:45:37.362190 14621 catalog_manager.cc:4841] TS c0f44a928b47451385991be6d767ec76 (127.19.242.194:44585): tablet 6db4f1b40b5e4a7ba2897cd79e46bdb1 (table test-table [id=8ea8e647fc5c4b1ba1df0cb824d2bf82]) successfully deleted
I20260808 08:45:37.363802 15363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.332662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45894 (local address 127.19.242.193:45927)
0808 08:45:37.332914 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:37.332923 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:37.339319 (+ 6396us) server_negotiation.cc:407] Connection header received
0808 08:45:37.339687 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:37.339696 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:37.339810 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:37.339908 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:37.342752 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.344435 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.347451 (+ 3016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.348274 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.348441 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.355045 (+ 6604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:37.355064 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:37.355085 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:37.355144 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:37.359881 (+ 4737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:37.361017 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:37.361027 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:37.361031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:37.361245 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:37.361775 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:37.361780 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:37.361784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:37.362275 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:37.362584 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:37.363135 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 08:45:37.363401 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:45:37.364630 14905 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:37.467097 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 14724
I20260808 08:45:37.498157 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 14925
Aug 08 08:45:37 dist-test-slave-39l8 krb5kdc[14578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:45:37.517134 15368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.499135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45660 (local address 127.19.242.194:44585)
0808 08:45:37.499465 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:37.499472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:37.499599 (+ 127us) server_negotiation.cc:407] Connection header received
0808 08:45:37.499879 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:37.499888 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:37.499982 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:37.500125 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:37.501619 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.502457 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.504181 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.504668 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.504828 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.510177 (+ 5349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:37.510198 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:37.510217 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:37.510267 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:37.513855 (+ 3588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:37.515006 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:37.515016 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:37.515018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:37.515185 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:37.515644 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:37.515648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:37.515650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:37.516093 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:37.516379 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:37.516653 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 08:45:37.516859 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260808 08:45:37.517925 15118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:37.612228 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 14925
I20260808 08:45:37.642578 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 15134
Aug 08 08:45:37 dist-test-slave-39l8 krb5kdc[14578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:45:37.660480 15369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:37.643612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44102 (local address 127.19.242.195:33539)
0808 08:45:37.643876 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:37.643882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:37.643906 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:45:37.644087 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:37.644092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:37.644159 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:37.644275 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:37.645678 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.646518 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.648095 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:37.648507 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:37.648656 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:37.654017 (+ 5361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:37.654037 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:37.654054 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:37.654108 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:37.657256 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:37.658117 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:37.658127 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:37.658130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:37.658284 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:37.658756 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:37.658773 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:37.658775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:37.659191 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:37.659520 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:37.659865 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 08:45:37.660104 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 08:45:37.661355 15328 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:37.753067 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 15134
I20260808 08:45:37.780438 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 14596
I20260808 08:45:37.781857 14684 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:37.897915 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 14596
2026-08-08T08:45:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5239 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T08:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:37Z Disabled control of system clock
I20260808 08:45:38.002319 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44497
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:44497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:45:38.377635 15422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:38.377969 15422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:38.378122 15422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:38.385973 15422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:38.386121 15422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:38.386161 15422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:38.386279 15422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:38.386369 15422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:38.396402 15422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:44497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:38.397864 15422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:38.399935 15422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:38.412906 15432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:38.413019 15431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:38.412997 15434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:38.414377 15422 server_base.cc:1034] running on GCE node
I20260808 08:45:38.415470 15422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:38.417536 15422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:38.418859 15422 hybrid_clock.cc:648] HybridClock initialized: now 1786178738418802 us; error 42 us; skew 500 ppm
I20260808 08:45:38.419284 15422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:38.427080 15422 webserver.cc:460] Webserver started at http://127.19.242.254:35715/ using document root <none> and password file <none>
I20260808 08:45:38.427914 15422 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:38.428040 15422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:38.428349 15422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:38.431708 15422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "a88578e1912e4084b2110756101d5d0e"
format_stamp: "Formatted at 2026-08-08 08:45:38 on dist-test-slave-39l8"
server_key: "b117eb0a9d66e8e57bf951343e5f6349"
server_key_iv: "a2d96d0b6b46d403e57a4d7ce43e2d7e"
server_key_version: "encryptionkey@0"
I20260808 08:45:38.432690 15422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "a88578e1912e4084b2110756101d5d0e"
format_stamp: "Formatted at 2026-08-08 08:45:38 on dist-test-slave-39l8"
server_key: "b117eb0a9d66e8e57bf951343e5f6349"
server_key_iv: "a2d96d0b6b46d403e57a4d7ce43e2d7e"
server_key_version: "encryptionkey@0"
I20260808 08:45:38.438889 15422 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260808 08:45:38.443259 15443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:38.445185 15422 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:45:38.445406 15422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "a88578e1912e4084b2110756101d5d0e"
format_stamp: "Formatted at 2026-08-08 08:45:38 on dist-test-slave-39l8"
server_key: "b117eb0a9d66e8e57bf951343e5f6349"
server_key_iv: "a2d96d0b6b46d403e57a4d7ce43e2d7e"
server_key_version: "encryptionkey@0"
I20260808 08:45:38.445642 15422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:38.467909 15422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:38.468909 15422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:38.469239 15422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:38.491572 15422 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:44497
I20260808 08:45:38.491619 15521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:44497 every 8 connection(s)
I20260808 08:45:38.493297 15422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:38.493829 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 15422
I20260808 08:45:38.494113 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:38.494850 20427 external_mini_cluster.cc:1428] Setting key 9b3dc120b74cc2cf51d37b1e14754963
I20260808 08:45:38.498348 15522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:38.511255 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:38.497041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35630 (local address 127.19.242.254:44497)
0808 08:45:38.498148 (+ 1107us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:38.498159 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:38.498203 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:45:38.500036 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:38.500063 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:38.500577 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:38.500929 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:38.501751 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:38.503331 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:38.505782 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:38.506564 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:38.506810 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:38.508305 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:38.508314 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:38.508332 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:38.508991 (+ 659us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:38.509079 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:38.509107 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:38.509216 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:38.509548 (+ 332us) server_negotiation.cc:299] Negotiation successful
0808 08:45:38.509996 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":431,"threads_started":1}
I20260808 08:45:38.513672 15522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e: Bootstrap starting.
I20260808 08:45:38.517741 15522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:38.519086 15522 log.cc:824] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:38.522619 15522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e: No bootstrap required, opened a new log
I20260808 08:45:38.530464 15522 raft_consensus.cc:348] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a88578e1912e4084b2110756101d5d0e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44497 } }
I20260808 08:45:38.531127 15522 raft_consensus.cc:374] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:38.531242 15522 raft_consensus.cc:729] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a88578e1912e4084b2110756101d5d0e, State: Initialized, Role: FOLLOWER
I20260808 08:45:38.532126 15522 consensus_queue.cc:260] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a88578e1912e4084b2110756101d5d0e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44497 } }
I20260808 08:45:38.532423 15522 raft_consensus.cc:388] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:38.532590 15522 raft_consensus.cc:482] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:38.532783 15522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:38.535645 15522 raft_consensus.cc:504] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a88578e1912e4084b2110756101d5d0e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44497 } }
I20260808 08:45:38.536358 15522 leader_election.cc:302] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a88578e1912e4084b2110756101d5d0e; no voters:
I20260808 08:45:38.537115 15522 leader_election.cc:288] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:38.537286 15528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:38.538127 15528 raft_consensus.cc:686] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [term 1 LEADER]: Becoming Leader. State: Replica: a88578e1912e4084b2110756101d5d0e, State: Running, Role: LEADER
I20260808 08:45:38.538817 15528 consensus_queue.cc:237] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a88578e1912e4084b2110756101d5d0e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44497 } }
I20260808 08:45:38.539894 15522 sys_catalog.cc:564] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:38.542413 15529 sys_catalog.cc:455] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a88578e1912e4084b2110756101d5d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a88578e1912e4084b2110756101d5d0e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44497 } } }
I20260808 08:45:38.542443 15532 sys_catalog.cc:455] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a88578e1912e4084b2110756101d5d0e. Latest consensus state: current_term: 1 leader_uuid: "a88578e1912e4084b2110756101d5d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a88578e1912e4084b2110756101d5d0e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44497 } } }
I20260808 08:45:38.542979 15532 sys_catalog.cc:458] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:38.542981 15529 sys_catalog.cc:458] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:38.544891 15539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:38.551695 15539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:38.563159 15539 catalog_manager.cc:1347] Generated new cluster ID: 4d5b631df94645bbb9efb162fee7102f
I20260808 08:45:38.563306 15539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:38.592542 15539 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:38.594494 15539 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:38.616807 15539 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e: Generated new TSK 0
I20260808 08:45:38.618141 15539 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:45:38.627909 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44497
--builtin_ntp_servers=127.19.242.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:45:39.025111 15558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:39.025437 15558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:39.025583 15558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:39.033383 15558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:39.033516 15558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:39.033694 15558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:45:39.044004 15558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:39.045503 15558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:39.047663 15558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:39.062814 15565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:39.063025 15569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:39.062837 15566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:39.064033 15558 server_base.cc:1034] running on GCE node
I20260808 08:45:39.064788 15558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:39.065891 15558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:39.067198 15558 hybrid_clock.cc:648] HybridClock initialized: now 1786178739067148 us; error 98 us; skew 500 ppm
I20260808 08:45:39.067581 15558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:39.070503 15558 webserver.cc:460] Webserver started at http://127.19.242.193:37705/ using document root <none> and password file <none>
I20260808 08:45:39.071462 15558 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:39.071630 15558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:39.072022 15558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:39.075757 15558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "5d32c4041d4543dfad35b01c8aa54539"
format_stamp: "Formatted at 2026-08-08 08:45:39 on dist-test-slave-39l8"
server_key: "6862f30f76ac7ba414b316445576f52a"
server_key_iv: "68cbacd4c9ab75697f2dcd2f0e5ce4f5"
server_key_version: "encryptionkey@0"
I20260808 08:45:39.076792 15558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "5d32c4041d4543dfad35b01c8aa54539"
format_stamp: "Formatted at 2026-08-08 08:45:39 on dist-test-slave-39l8"
server_key: "6862f30f76ac7ba414b316445576f52a"
server_key_iv: "68cbacd4c9ab75697f2dcd2f0e5ce4f5"
server_key_version: "encryptionkey@0"
I20260808 08:45:39.083400 15558 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:45:39.087962 15578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:39.089704 15558 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:45:39.089951 15558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "5d32c4041d4543dfad35b01c8aa54539"
format_stamp: "Formatted at 2026-08-08 08:45:39 on dist-test-slave-39l8"
server_key: "6862f30f76ac7ba414b316445576f52a"
server_key_iv: "68cbacd4c9ab75697f2dcd2f0e5ce4f5"
server_key_version: "encryptionkey@0"
I20260808 08:45:39.090265 15558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:39.106686 15558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:39.107870 15558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:39.108268 15558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:39.109424 15558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:39.111341 15558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:39.111491 15558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:39.111649 15558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:39.111742 15558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:39.149390 15558 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:34585
I20260808 08:45:39.149451 15741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:34585 every 8 connection(s)
I20260808 08:45:39.151285 15558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:45:39.160341 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 15558
I20260808 08:45:39.160558 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:45:39.161070 20427 external_mini_cluster.cc:1428] Setting key 4248d9255c86518e3e993c6e7f5cdf00
I20260808 08:45:39.164314 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44497
--builtin_ntp_servers=127.19.242.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:45:39.166115 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:39.154285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:39345 (local address 127.19.242.254:44497)
0808 08:45:39.154830 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:39.154838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:39.156167 (+ 1329us) server_negotiation.cc:407] Connection header received
0808 08:45:39.158055 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:39.158060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:39.158205 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:39.158325 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:39.159603 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.160400 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.162775 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.163226 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.163393 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:39.165180 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:39.165185 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:39.165189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:39.165210 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:39.165260 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:39.165274 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:39.165387 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:39.165646 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 08:45:39.165769 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":244,"threads_started":1}
I20260808 08:45:39.167474 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:39.154976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44497 (local address 127.19.242.193:39345)
0808 08:45:39.155962 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:39.156011 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:39.157726 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:39.158571 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:39.158580 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:39.158680 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:39.159399 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:39.159418 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.160672 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.160679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:39.162569 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:39.162585 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.163508 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.163553 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:39.163843 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:39.164776 (+ 933us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:39.164779 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:39.164830 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:39.164930 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:39.165387 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:39.165403 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:39.165414 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:45:39.165632 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 08:45:39.166119 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":309,"threads_started":1}
I20260808 08:45:39.169315 15743 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44497
I20260808 08:45:39.169683 15743 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:39.170574 15743 heartbeater.cc:511] Master 127.19.242.254:44497 requested a full tablet report, sending...
I20260808 08:45:39.172958 15473 ts_manager.cc:194] Registered new tserver with Master: 5d32c4041d4543dfad35b01c8aa54539 (127.19.242.193:34585)
I20260808 08:45:39.174553 15473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.193:39345
W20260808 08:45:39.555171 15747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:39.555502 15747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:39.555596 15747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:39.563210 15747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:39.563335 15747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:39.563448 15747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:45:39.573817 15747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:39.575311 15747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:39.577312 15747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:39.593034 15755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:39.593287 15758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:39.593009 15760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:39.594457 15747 server_base.cc:1034] running on GCE node
I20260808 08:45:39.595300 15747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:39.596482 15747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:39.597769 15747 hybrid_clock.cc:648] HybridClock initialized: now 1786178739597728 us; error 36 us; skew 500 ppm
I20260808 08:45:39.598160 15747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:39.601027 15747 webserver.cc:460] Webserver started at http://127.19.242.194:39195/ using document root <none> and password file <none>
I20260808 08:45:39.601850 15747 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:39.602062 15747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:39.602488 15747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:39.606078 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "89010d20e17c48cfb2e9d30b48a11ca5"
format_stamp: "Formatted at 2026-08-08 08:45:39 on dist-test-slave-39l8"
server_key: "56f8de43de76792ff5f56310aec84026"
server_key_iv: "5f1a5ec81c7d5ecb63ed4b3b4c8059d0"
server_key_version: "encryptionkey@0"
I20260808 08:45:39.607226 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "89010d20e17c48cfb2e9d30b48a11ca5"
format_stamp: "Formatted at 2026-08-08 08:45:39 on dist-test-slave-39l8"
server_key: "56f8de43de76792ff5f56310aec84026"
server_key_iv: "5f1a5ec81c7d5ecb63ed4b3b4c8059d0"
server_key_version: "encryptionkey@0"
I20260808 08:45:39.613615 15747 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 08:45:39.618257 15771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:39.620036 15747 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:39.620277 15747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "89010d20e17c48cfb2e9d30b48a11ca5"
format_stamp: "Formatted at 2026-08-08 08:45:39 on dist-test-slave-39l8"
server_key: "56f8de43de76792ff5f56310aec84026"
server_key_iv: "5f1a5ec81c7d5ecb63ed4b3b4c8059d0"
server_key_version: "encryptionkey@0"
I20260808 08:45:39.620554 15747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:39.635042 15747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:39.636024 15747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:39.636372 15747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:39.637506 15747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:39.639307 15747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:39.639442 15747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:39.639596 15747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:39.639698 15747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:39.677302 15747 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:44105
I20260808 08:45:39.677400 15930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:44105 every 8 connection(s)
I20260808 08:45:39.678833 15747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:45:39.684254 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 15747
I20260808 08:45:39.684491 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:45:39.684975 20427 external_mini_cluster.cc:1428] Setting key 7cd2f469f45c5305dfdf493a84e26a0c
I20260808 08:45:39.688474 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44497
--builtin_ntp_servers=127.19.242.212:34373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:45:39.695729 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:39.681792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:49519 (local address 127.19.242.254:44497)
0808 08:45:39.682329 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:39.682334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:39.683782 (+ 1448us) server_negotiation.cc:407] Connection header received
0808 08:45:39.685923 (+ 2141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:39.685929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:39.686066 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:39.686209 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:39.687973 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.688888 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.691906 (+ 3018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.692385 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.692508 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:39.694541 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:39.694547 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:39.694550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:39.694575 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:39.694620 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:39.694632 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:39.694766 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:39.695107 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 08:45:39.695307 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":290,"threads_started":1}
I20260808 08:45:39.697173 15936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:39.682359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44497 (local address 127.19.242.194:49519)
0808 08:45:39.683589 (+ 1230us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:39.683633 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:39.685580 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:39.686505 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:39.686515 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:39.686623 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:39.687734 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:39.687768 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.689077 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.689086 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:39.691652 (+ 2566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:39.691680 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:39.692691 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:39.692702 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:39.693104 (+ 402us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:39.694042 (+ 938us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:39.694048 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:39.694132 (+ 84us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:39.694261 (+ 129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:39.694771 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:39.694787 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:39.694799 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:45:39.695010 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 08:45:39.695533 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":504,"threads_started":1}
I20260808 08:45:39.699178 15931 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44497
I20260808 08:45:39.699572 15931 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:39.700467 15931 heartbeater.cc:511] Master 127.19.242.254:44497 requested a full tablet report, sending...
I20260808 08:45:39.702227 15473 ts_manager.cc:194] Registered new tserver with Master: 89010d20e17c48cfb2e9d30b48a11ca5 (127.19.242.194:44105)
I20260808 08:45:39.703147 15473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.194:49519
W20260808 08:45:40.061465 15937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:40.061812 15937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:40.061904 15937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:40.069437 15937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:40.069573 15937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:40.069693 15937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:45:40.079434 15937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:44497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:40.080806 15937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:40.082646 15937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:40.098371 15943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:40.098282 15944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:40.098332 15946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:40.099653 15937 server_base.cc:1034] running on GCE node
I20260808 08:45:40.100581 15937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:40.101676 15937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:40.102903 15937 hybrid_clock.cc:648] HybridClock initialized: now 1786178740102849 us; error 45 us; skew 500 ppm
I20260808 08:45:40.103298 15937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:40.106026 15937 webserver.cc:460] Webserver started at http://127.19.242.195:36445/ using document root <none> and password file <none>
I20260808 08:45:40.106940 15937 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:40.107051 15937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:40.107362 15937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:40.110574 15937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "28ee9a6f6f094b679a09508d08cab0ab"
format_stamp: "Formatted at 2026-08-08 08:45:40 on dist-test-slave-39l8"
server_key: "59acca59a768851d718b1a796948adbf"
server_key_iv: "564c51048da1c41cfcc8162e1cc7ece6"
server_key_version: "encryptionkey@0"
I20260808 08:45:40.111557 15937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "28ee9a6f6f094b679a09508d08cab0ab"
format_stamp: "Formatted at 2026-08-08 08:45:40 on dist-test-slave-39l8"
server_key: "59acca59a768851d718b1a796948adbf"
server_key_iv: "564c51048da1c41cfcc8162e1cc7ece6"
server_key_version: "encryptionkey@0"
I20260808 08:45:40.117786 15937 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260808 08:45:40.122538 15955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:40.124431 15937 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:40.124611 15937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "28ee9a6f6f094b679a09508d08cab0ab"
format_stamp: "Formatted at 2026-08-08 08:45:40 on dist-test-slave-39l8"
server_key: "59acca59a768851d718b1a796948adbf"
server_key_iv: "564c51048da1c41cfcc8162e1cc7ece6"
server_key_version: "encryptionkey@0"
I20260808 08:45:40.124863 15937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:40.144285 15937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:40.145310 15937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:40.145601 15937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:40.146788 15937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:40.148470 15937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:40.148571 15937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:40.148716 15937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:40.148816 15937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:40.178368 15743 heartbeater.cc:503] Master 127.19.242.254:44497 was elected leader, sending a full tablet report...
I20260808 08:45:40.187933 15937 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:34667
I20260808 08:45:40.188023 16122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:34667 every 8 connection(s)
I20260808 08:45:40.189495 15937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:45:40.198442 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 15937
I20260808 08:45:40.198653 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:45:40.199141 20427 external_mini_cluster.cc:1428] Setting key 7386e0738d42af375ba1305343628795
I20260808 08:45:40.203353 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.192154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:43871 (local address 127.19.242.254:44497)
0808 08:45:40.192369 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.192374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.193906 (+ 1532us) server_negotiation.cc:407] Connection header received
0808 08:45:40.195846 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.195852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.195951 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.196071 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:40.197196 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.197985 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.200016 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.200653 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.200809 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.202451 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:40.202456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:40.202459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:40.202477 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:40.202509 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:40.202521 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:40.202622 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.202920 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.203024 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 08:45:40.204492 16125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.192706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:44497 (local address 127.19.242.195:43871)
0808 08:45:40.193717 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:40.193755 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:40.195548 (+ 1793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:40.196333 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:40.196342 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:40.196434 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:40.197013 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.197029 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.198151 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.198161 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.199821 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.199839 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.200914 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.200924 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.201189 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.202080 (+ 891us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:40.202085 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:40.202140 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:40.202235 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:40.202623 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:40.202637 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:40.202648 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:45:40.202910 (+ 262us) client_negotiation.cc:240] Negotiation successful
0808 08:45:40.203376 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":307,"threads_started":1}
I20260808 08:45:40.205940 16123 heartbeater.cc:347] Connected to a master server at 127.19.242.254:44497
I20260808 08:45:40.206272 16123 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:40.207126 16123 heartbeater.cc:511] Master 127.19.242.254:44497 requested a full tablet report, sending...
I20260808 08:45:40.208801 15473 ts_manager.cc:194] Registered new tserver with Master: 28ee9a6f6f094b679a09508d08cab0ab (127.19.242.195:34667)
I20260808 08:45:40.209642 15473 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.195:43871
I20260808 08:45:40.215102 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:45:40.226584 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.219630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35634 (local address 127.19.242.254:44497)
0808 08:45:40.219834 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.219838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.220335 (+ 497us) server_negotiation.cc:407] Connection header received
0808 08:45:40.220562 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.220567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.220639 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.220738 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:40.221367 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.222115 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.223704 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.224135 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.224239 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.225762 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:40.225770 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:40.225775 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:40.225802 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:40.225852 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:40.225868 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:40.226006 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.226237 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.226297 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:45:40.231498 15473 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35634:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:45:40.239070 15473 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:45:40.277906 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.253553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:44105 (local address 127.0.0.1:46960)
0808 08:45:40.255543 (+ 1990us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:40.255602 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:40.255794 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:40.270857 (+ 15063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:40.270864 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:40.270901 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:40.271373 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.271383 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.273189 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.273198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.275244 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.275262 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.276848 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.276855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.277054 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.277104 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 08:45:40.277260 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 08:45:40.277479 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1712,"mutex_wait_us":95,"thread_start_us":12764,"threads_started":1}
I20260808 08:45:40.278779 16148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.256649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51792 (local address 127.19.242.195:34667)
0808 08:45:40.268643 (+ 11994us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.268655 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.268704 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:45:40.268833 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.268843 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.269162 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.269436 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:40.270270 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.271916 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.275328 (+ 3412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.276761 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.276979 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.277247 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.278163 (+ 916us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.278354 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11783,"thread_start_us":11587,"threads_started":1}
I20260808 08:45:40.278414 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.253723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:34585 (local address 127.0.0.1:45326)
0808 08:45:40.256548 (+ 2825us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:40.256567 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:40.256687 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:40.270500 (+ 13813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:40.270504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:40.270532 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:40.271019 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.271097 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.272981 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.272986 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.275563 (+ 2577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.275581 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.277511 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.277518 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.277681 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.277714 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:45:40.277806 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:45:40.277948 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2684,"mutex_wait_us":108,"thread_start_us":1359,"threads_started":1}
I20260808 08:45:40.278019 16140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.255988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:34667 (local address 127.0.0.1:51792)
0808 08:45:40.266757 (+ 10769us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:40.266789 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:40.266991 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:40.269521 (+ 2530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:40.269532 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:40.269590 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:40.270036 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.270049 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.272109 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.272115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.275057 (+ 2942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.275075 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.277264 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.277272 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.277452 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.277485 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:45:40.277568 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:45:40.277693 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10542,"mutex_wait_us":26,"thread_start_us":1002,"threads_started":1}
I20260808 08:45:40.279393 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.254378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45326 (local address 127.19.242.193:34585)
0808 08:45:40.269921 (+ 15543us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.269927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.269949 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:45:40.270025 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.270030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.270253 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.270473 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:40.271291 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.272814 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.275806 (+ 2992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.277271 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.277545 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.277741 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.277862 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.278041 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15384,"thread_start_us":15232,"threads_started":1}
I20260808 08:45:40.279613 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.254199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46960 (local address 127.19.242.194:44105)
0808 08:45:40.268973 (+ 14774us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.268981 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.269008 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:45:40.269109 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.269116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.269317 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.270880 (+ 1563us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:40.271553 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.272977 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.275521 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.276630 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.276848 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.277093 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.278635 (+ 1542us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.279239 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14620,"thread_start_us":14509,"threads_started":1}
I20260808 08:45:40.283190 15843 tablet_service.cc:1467] Processing CreateTablet for tablet 419846063736405cb821ca73dd4a76e6 (DEFAULT_TABLE table=test-table [id=625de018812f4ddea8142b7723f03c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:40.283267 15650 tablet_service.cc:1467] Processing CreateTablet for tablet 419846063736405cb821ca73dd4a76e6 (DEFAULT_TABLE table=test-table [id=625de018812f4ddea8142b7723f03c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:40.283267 16025 tablet_service.cc:1467] Processing CreateTablet for tablet 419846063736405cb821ca73dd4a76e6 (DEFAULT_TABLE table=test-table [id=625de018812f4ddea8142b7723f03c6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:40.284598 15843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419846063736405cb821ca73dd4a76e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:40.284788 16025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419846063736405cb821ca73dd4a76e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:40.284798 15650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 419846063736405cb821ca73dd4a76e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:40.300509 16152 tablet_bootstrap.cc:492] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Bootstrap starting.
I20260808 08:45:40.303350 16150 tablet_bootstrap.cc:492] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Bootstrap starting.
I20260808 08:45:40.307060 16153 tablet_bootstrap.cc:492] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Bootstrap starting.
I20260808 08:45:40.306625 16152 tablet_bootstrap.cc:654] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:40.307838 16150 tablet_bootstrap.cc:654] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:40.309201 16150 log.cc:824] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:40.309254 16152 log.cc:824] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:40.311205 16153 tablet_bootstrap.cc:654] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:40.312361 16150 tablet_bootstrap.cc:492] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: No bootstrap required, opened a new log
I20260808 08:45:40.312675 16150 ts_tablet_manager.cc:1397] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 08:45:40.312990 16153 log.cc:824] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:40.316887 16153 tablet_bootstrap.cc:492] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: No bootstrap required, opened a new log
I20260808 08:45:40.317106 16152 tablet_bootstrap.cc:492] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: No bootstrap required, opened a new log
I20260808 08:45:40.317446 16152 ts_tablet_manager.cc:1397] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.007s
I20260808 08:45:40.317425 16153 ts_tablet_manager.cc:1397] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260808 08:45:40.323781 16150 raft_consensus.cc:348] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.324380 16150 raft_consensus.cc:374] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:40.324498 16150 raft_consensus.cc:729] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89010d20e17c48cfb2e9d30b48a11ca5, State: Initialized, Role: FOLLOWER
I20260808 08:45:40.325277 16150 consensus_queue.cc:260] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.325273 16153 raft_consensus.cc:348] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.325703 16153 raft_consensus.cc:374] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:40.325819 16153 raft_consensus.cc:729] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28ee9a6f6f094b679a09508d08cab0ab, State: Initialized, Role: FOLLOWER
I20260808 08:45:40.326694 15931 heartbeater.cc:503] Master 127.19.242.254:44497 was elected leader, sending a full tablet report...
I20260808 08:45:40.326622 16153 consensus_queue.cc:260] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.328828 16150 ts_tablet_manager.cc:1428] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260808 08:45:40.330633 16152 raft_consensus.cc:348] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.331111 16152 raft_consensus.cc:374] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:40.331219 16152 raft_consensus.cc:729] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d32c4041d4543dfad35b01c8aa54539, State: Initialized, Role: FOLLOWER
I20260808 08:45:40.331877 16152 consensus_queue.cc:260] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.334129 16123 heartbeater.cc:503] Master 127.19.242.254:44497 was elected leader, sending a full tablet report...
I20260808 08:45:40.335335 16153 ts_tablet_manager.cc:1428] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Time spent starting tablet: real 0.018s user 0.012s sys 0.004s
I20260808 08:45:40.337702 16152 ts_tablet_manager.cc:1428] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Time spent starting tablet: real 0.020s user 0.004s sys 0.013s
W20260808 08:45:40.404219 15744 tablet.cc:2369] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:45:40.431241 15932 tablet.cc:2369] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:45:40.441347 16124 tablet.cc:2369] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:40.604360 16159 raft_consensus.cc:482] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:45:40.604753 16159 raft_consensus.cc:504] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.606555 16159 leader_election.cc:288] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d32c4041d4543dfad35b01c8aa54539 (127.19.242.193:34585), 28ee9a6f6f094b679a09508d08cab0ab (127.19.242.195:34667)
I20260808 08:45:40.614235 16148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.607895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:46401 (local address 127.19.242.195:34667)
0808 08:45:40.608147 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.608156 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.608600 (+ 444us) server_negotiation.cc:407] Connection header received
0808 08:45:40.608729 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.608735 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.608818 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.608921 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:40.609525 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.610474 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.612487 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.613339 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.613508 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.613584 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.613876 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.614007 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:45:40.614281 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.607227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:58253 (local address 127.19.242.193:34585)
0808 08:45:40.607496 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.607504 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.607783 (+ 279us) server_negotiation.cc:407] Connection header received
0808 08:45:40.608031 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.608038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.608148 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.608273 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:40.608963 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.609902 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.612263 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.613155 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.613302 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.613354 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.613807 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.613951 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:45:40.614339 16167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.606951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:34585 (local address 127.19.242.194:58253)
0808 08:45:40.607647 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:40.607664 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:40.607873 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:40.608324 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:40.608331 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:40.608373 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:40.608794 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.608809 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.610048 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.610053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.611988 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.612016 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.613391 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.613399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.613634 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.613660 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:45:40.613740 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 08:45:40.613892 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":27,"thread_start_us":358,"threads_started":1}
I20260808 08:45:40.614601 16168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.607821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:34667 (local address 127.19.242.194:46401)
0808 08:45:40.608479 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:40.608495 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:40.608604 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:40.608961 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:40.608966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:40.608990 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:40.609356 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.609368 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.610637 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.610641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.612278 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:40.612293 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.613532 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.613540 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:40.613674 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.613705 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:45:40.613827 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:45:40.613957 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":58,"thread_start_us":315,"threads_started":1}
I20260808 08:45:40.615718 15676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419846063736405cb821ca73dd4a76e6" candidate_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d32c4041d4543dfad35b01c8aa54539" is_pre_election: true
I20260808 08:45:40.615800 16057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419846063736405cb821ca73dd4a76e6" candidate_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28ee9a6f6f094b679a09508d08cab0ab" is_pre_election: true
I20260808 08:45:40.616408 15676 raft_consensus.cc:2454] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89010d20e17c48cfb2e9d30b48a11ca5 in term 0.
I20260808 08:45:40.616407 16057 raft_consensus.cc:2454] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89010d20e17c48cfb2e9d30b48a11ca5 in term 0.
I20260808 08:45:40.617193 15773 leader_election.cc:302] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d32c4041d4543dfad35b01c8aa54539, 89010d20e17c48cfb2e9d30b48a11ca5; no voters:
I20260808 08:45:40.617650 16159 raft_consensus.cc:2781] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:45:40.617827 16159 raft_consensus.cc:482] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:45:40.617951 16159 raft_consensus.cc:3037] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:40.620434 16159 raft_consensus.cc:504] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.621088 16159 leader_election.cc:288] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [CANDIDATE]: Term 1 election: Requested vote from peers 5d32c4041d4543dfad35b01c8aa54539 (127.19.242.193:34585), 28ee9a6f6f094b679a09508d08cab0ab (127.19.242.195:34667)
I20260808 08:45:40.621975 16057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419846063736405cb821ca73dd4a76e6" candidate_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28ee9a6f6f094b679a09508d08cab0ab"
I20260808 08:45:40.621980 15676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "419846063736405cb821ca73dd4a76e6" candidate_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d32c4041d4543dfad35b01c8aa54539"
I20260808 08:45:40.622205 16057 raft_consensus.cc:3037] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:40.622269 15676 raft_consensus.cc:3037] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:40.624734 16057 raft_consensus.cc:2454] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89010d20e17c48cfb2e9d30b48a11ca5 in term 1.
I20260808 08:45:40.624783 15676 raft_consensus.cc:2454] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89010d20e17c48cfb2e9d30b48a11ca5 in term 1.
I20260808 08:45:40.625358 15773 leader_election.cc:302] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28ee9a6f6f094b679a09508d08cab0ab, 89010d20e17c48cfb2e9d30b48a11ca5; no voters:
I20260808 08:45:40.625742 16159 raft_consensus.cc:2781] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:40.626251 16159 raft_consensus.cc:686] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 89010d20e17c48cfb2e9d30b48a11ca5, State: Running, Role: LEADER
I20260808 08:45:40.626909 16159 consensus_queue.cc:237] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } }
I20260808 08:45:40.632516 15471 catalog_manager.cc:5495] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89010d20e17c48cfb2e9d30b48a11ca5 (127.19.242.194). New cstate: current_term: 1 leader_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89010d20e17c48cfb2e9d30b48a11ca5" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 44105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 } health_report { overall_health: UNKNOWN } } }
I20260808 08:45:40.730356 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.723998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46964 (local address 127.19.242.194:44105)
0808 08:45:40.724219 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.724226 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.724322 (+ 96us) server_negotiation.cc:407] Connection header received
0808 08:45:40.724637 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.724641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.724752 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.724967 (+ 215us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:45:40.725410 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.726242 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.727796 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.728227 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.728381 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.729127 (+ 746us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:45:40.729660 (+ 533us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:45:40.729865 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.730036 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.730083 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:45:40.739512 15676 raft_consensus.cc:1261] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 1 FOLLOWER]: Refusing update from remote peer 89010d20e17c48cfb2e9d30b48a11ca5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:40.739506 16057 raft_consensus.cc:1261] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 1 FOLLOWER]: Refusing update from remote peer 89010d20e17c48cfb2e9d30b48a11ca5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:40.740733 16169 consensus_queue.cc:1035] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28ee9a6f6f094b679a09508d08cab0ab" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 34667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:40.741361 16159 consensus_queue.cc:1035] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d32c4041d4543dfad35b01c8aa54539" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:40.769203 15472 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:40.769536 15472 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:40.774075 15472 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a88578e1912e4084b2110756101d5d0e: Sending DeleteTablet for 3 replicas of tablet 419846063736405cb821ca73dd4a76e6
I20260808 08:45:40.775667 15650 tablet_service.cc:1514] Processing DeleteTablet for tablet 419846063736405cb821ca73dd4a76e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:40 UTC) from {username='slave'} at 127.0.0.1:45326
I20260808 08:45:40.775674 15843 tablet_service.cc:1514] Processing DeleteTablet for tablet 419846063736405cb821ca73dd4a76e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:40 UTC) from {username='slave'} at 127.0.0.1:46960
I20260808 08:45:40.776543 16025 tablet_service.cc:1514] Processing DeleteTablet for tablet 419846063736405cb821ca73dd4a76e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:40 UTC) from {username='slave'} at 127.0.0.1:51792
I20260808 08:45:40.779805 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 15558
I20260808 08:45:40.802268 16191 tablet_replica.cc:330] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: stopping tablet replica
I20260808 08:45:40.802937 16191 raft_consensus.cc:2229] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:40.803562 16191 raft_consensus.cc:2258] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:40.804591 16189 tablet_replica.cc:330] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: stopping tablet replica
I20260808 08:45:40.805105 16189 raft_consensus.cc:2229] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:40.805651 16189 raft_consensus.cc:2258] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:40.806533 16190 tablet_replica.cc:330] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: stopping tablet replica
I20260808 08:45:40.807040 16190 raft_consensus.cc:2229] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:45:40.807817 16190 raft_consensus.cc:2258] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:40.809397 16191 ts_tablet_manager.cc:1905] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:40.810004 16189 ts_tablet_manager.cc:1905] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:40.811223 16190 ts_tablet_manager.cc:1905] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:40.817376 16191 ts_tablet_manager.cc:1918] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:40.817708 16191 log.cc:1196] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/419846063736405cb821ca73dd4a76e6
I20260808 08:45:40.817689 16189 ts_tablet_manager.cc:1918] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:40.817930 16189 log.cc:1196] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/419846063736405cb821ca73dd4a76e6
I20260808 08:45:40.818500 16191 ts_tablet_manager.cc:1939] T 419846063736405cb821ca73dd4a76e6 P 28ee9a6f6f094b679a09508d08cab0ab: Deleting consensus metadata
I20260808 08:45:40.818549 16189 ts_tablet_manager.cc:1939] T 419846063736405cb821ca73dd4a76e6 P 5d32c4041d4543dfad35b01c8aa54539: Deleting consensus metadata
I20260808 08:45:40.820741 15445 catalog_manager.cc:4841] TS 28ee9a6f6f094b679a09508d08cab0ab (127.19.242.195:34667): tablet 419846063736405cb821ca73dd4a76e6 (table test-table [id=625de018812f4ddea8142b7723f03c6c]) successfully deleted
I20260808 08:45:40.821195 15445 catalog_manager.cc:4841] TS 5d32c4041d4543dfad35b01c8aa54539 (127.19.242.193:34585): tablet 419846063736405cb821ca73dd4a76e6 (table test-table [id=625de018812f4ddea8142b7723f03c6c]) successfully deleted
I20260808 08:45:40.821792 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.781368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45340 (local address 127.19.242.193:34585)
0808 08:45:40.781558 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.781565 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.801101 (+ 19536us) server_negotiation.cc:407] Connection header received
0808 08:45:40.801503 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.801513 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.801688 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.801811 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:40.802889 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.804371 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.807080 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.807753 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.807874 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.819668 (+ 11794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:40.819682 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:40.819701 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:40.820546 (+ 845us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:40.820632 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:40.820664 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:40.820790 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.821270 (+ 480us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.821418 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:45:40.822324 16190 ts_tablet_manager.cc:1918] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:40.822578 16190 log.cc:1196] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/419846063736405cb821ca73dd4a76e6
I20260808 08:45:40.822727 15736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:40.823364 16190 ts_tablet_manager.cc:1939] T 419846063736405cb821ca73dd4a76e6 P 89010d20e17c48cfb2e9d30b48a11ca5: Deleting consensus metadata
I20260808 08:45:40.826807 15448 catalog_manager.cc:4841] TS 89010d20e17c48cfb2e9d30b48a11ca5 (127.19.242.194:44105): tablet 419846063736405cb821ca73dd4a76e6 (table test-table [id=625de018812f4ddea8142b7723f03c6c]) successfully deleted
I20260808 08:45:40.914029 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 15558
I20260808 08:45:40.940158 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 15747
I20260808 08:45:40.949549 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:40.941090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46980 (local address 127.19.242.194:44105)
0808 08:45:40.941274 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:40.941278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:40.941468 (+ 190us) server_negotiation.cc:407] Connection header received
0808 08:45:40.941617 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:40.941623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:40.941748 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:40.941868 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:40.942376 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.943338 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.945403 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:40.945928 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:40.946065 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:40.947811 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:40.947827 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:40.947845 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:40.948576 (+ 731us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:40.948633 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:40.948660 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:40.948821 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:40.948993 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 08:45:40.949135 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:45:40.950428 15923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:41.068020 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 15747
I20260808 08:45:41.092787 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 15937
I20260808 08:45:41.100514 16148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:41.093732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51796 (local address 127.19.242.195:34667)
0808 08:45:41.093918 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:41.093923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:41.093944 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:45:41.094087 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:41.094093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:41.094181 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:41.094267 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:41.094690 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:41.095480 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:41.096800 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:41.097201 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:41.097302 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:41.098693 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:41.098780 (+ 87us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:41.098805 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:41.099491 (+ 686us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:41.099569 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:41.099593 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:41.099696 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:41.099952 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 08:45:41.100111 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:45:41.101323 16118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:41.193778 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 15937
I20260808 08:45:41.219211 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 15422
I20260808 08:45:41.220580 15517 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:41.335232 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 15422
2026-08-08T08:45:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3441 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:41 dist-test-slave-39l8 krb5kdc[16203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:41 dist-test-slave-39l8 krb5kdc[16203](info): set up 2 sockets
Aug 08 08:45:41 dist-test-slave-39l8 krb5kdc[16203](info): commencing operation
krb5kdc: starting...
W20260808 08:45:42.752645 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:45:42 dist-test-slave-39l8 krb5kdc[16203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:45:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:45:43.134969 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:34943
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:34943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:43.518438 16230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:43.518814 16230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:43.519047 16230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:43.526628 16230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:43.526872 16230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:43.526993 16230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:43.527107 16230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:43.527176 16230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:43.539363 16230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:34943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:34943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:43.540933 16230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:43.542366 16230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:43.555807 16235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:43.555853 16237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:43.555902 16240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:43.557164 16230 server_base.cc:1034] running on GCE node
I20260808 08:45:43.558187 16230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:43.559894 16230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:43.561228 16230 hybrid_clock.cc:648] HybridClock initialized: now 1786178743561168 us; error 63 us; skew 500 ppm
I20260808 08:45:43.561663 16230 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:43 dist-test-slave-39l8 krb5kdc[16203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178743, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:43.570152 16230 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:45:43.572132 16230 webserver.cc:460] Webserver started at http://127.19.242.254:40539/ using document root <none> and password file <none>
I20260808 08:45:43.572957 16230 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:43.573137 16230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:43.573504 16230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:43.577230 16230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "4e57196d4ce34405bbf9c5c734e02b95"
format_stamp: "Formatted at 2026-08-08 08:45:43 on dist-test-slave-39l8"
server_key: "1812c86a8d9d6d489f6d59ce4b990fdf"
server_key_iv: "4a7884dcd171524255c117147e6f3a2b"
server_key_version: "encryptionkey@0"
I20260808 08:45:43.578110 16230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "4e57196d4ce34405bbf9c5c734e02b95"
format_stamp: "Formatted at 2026-08-08 08:45:43 on dist-test-slave-39l8"
server_key: "1812c86a8d9d6d489f6d59ce4b990fdf"
server_key_iv: "4a7884dcd171524255c117147e6f3a2b"
server_key_version: "encryptionkey@0"
I20260808 08:45:43.584389 16230 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 08:45:43.588765 16248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:43.590487 16230 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:45:43.590775 16230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "4e57196d4ce34405bbf9c5c734e02b95"
format_stamp: "Formatted at 2026-08-08 08:45:43 on dist-test-slave-39l8"
server_key: "1812c86a8d9d6d489f6d59ce4b990fdf"
server_key_iv: "4a7884dcd171524255c117147e6f3a2b"
server_key_version: "encryptionkey@0"
I20260808 08:45:43.591028 16230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:43.617887 16230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:43.622998 16230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:43.623317 16230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:43.644801 16230 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:34943
I20260808 08:45:43.644838 16331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:34943 every 8 connection(s)
I20260808 08:45:43.646301 16230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:43.650821 16332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:43.652935 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 16230
I20260808 08:45:43.653138 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:43.653590 20427 external_mini_cluster.cc:1428] Setting key 3238e240a7b74762b54773e461b325f5
I20260808 08:45:43.668277 16332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95: Bootstrap starting.
Aug 08 08:45:43 dist-test-slave-39l8 krb5kdc[16203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:43.673106 16332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:43.674863 16332 log.cc:824] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:43.679275 16332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95: No bootstrap required, opened a new log
I20260808 08:45:43.683495 16336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:43.655780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57050 (local address 127.19.242.254:34943)
0808 08:45:43.656740 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:43.656752 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:43.656801 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:45:43.658525 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:43.658555 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:43.659139 (+ 584us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:43.659514 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:43.661933 (+ 2419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:43.663417 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:43.665775 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:43.666514 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:43.666663 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:43.672711 (+ 6048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:43.672725 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:43.672751 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:43.672826 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:43.677565 (+ 4739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:43.678531 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:43.678542 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:43.678552 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:43.678846 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:43.679631 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:43.679637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:43.679640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:43.680518 (+ 878us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:43.680873 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:43.681349 (+ 476us) server_negotiation.cc:299] Negotiation successful
0808 08:45:43.681905 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":458,"threads_started":1}
I20260808 08:45:43.689505 16332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e57196d4ce34405bbf9c5c734e02b95" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 34943 } }
I20260808 08:45:43.689918 16332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:43.689999 16332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e57196d4ce34405bbf9c5c734e02b95, State: Initialized, Role: FOLLOWER
I20260808 08:45:43.690599 16332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e57196d4ce34405bbf9c5c734e02b95" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 34943 } }
I20260808 08:45:43.690948 16332 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:43.691059 16332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:43.691215 16332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:43.693774 16332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e57196d4ce34405bbf9c5c734e02b95" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 34943 } }
I20260808 08:45:43.694473 16332 leader_election.cc:302] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e57196d4ce34405bbf9c5c734e02b95; no voters:
I20260808 08:45:43.695286 16332 leader_election.cc:288] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:43.695704 16338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:43.696753 16338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [term 1 LEADER]: Becoming Leader. State: Replica: 4e57196d4ce34405bbf9c5c734e02b95, State: Running, Role: LEADER
I20260808 08:45:43.697371 16338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e57196d4ce34405bbf9c5c734e02b95" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 34943 } }
I20260808 08:45:43.697865 16332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:43.701156 16339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e57196d4ce34405bbf9c5c734e02b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e57196d4ce34405bbf9c5c734e02b95" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 34943 } } }
I20260808 08:45:43.701224 16340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e57196d4ce34405bbf9c5c734e02b95. Latest consensus state: current_term: 1 leader_uuid: "4e57196d4ce34405bbf9c5c734e02b95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e57196d4ce34405bbf9c5c734e02b95" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 34943 } } }
I20260808 08:45:43.701625 16339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:43.701687 16340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:43.704404 16346 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:43.711854 16346 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:43.724164 16346 catalog_manager.cc:1347] Generated new cluster ID: 0e22c636d96b45ee98621dc6901bf946
I20260808 08:45:43.724313 16346 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:43.739550 16346 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:43.741159 16346 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:43.756249 16346 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95: Generated new TSK 0
I20260808 08:45:43.757225 16346 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.242.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
Entry for principal kudu/127.19.242.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab.
I20260808 08:45:43.843632 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:34943
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:44.240232 16368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:44.240584 16368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:44.240758 16368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:44.248586 16368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:44.248735 16368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:44.248939 16368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:45:44.259528 16368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.193.keytab
--principal=kudu/127.19.242.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:34943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:44.261009 16368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:44.262672 16368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:44.278931 16381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:44.278972 16377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:44.279034 16376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:44.291508 16368 server_base.cc:1034] running on GCE node
I20260808 08:45:44.292455 16368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:44.293781 16368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:44.295019 16368 hybrid_clock.cc:648] HybridClock initialized: now 1786178744294941 us; error 70 us; skew 500 ppm
I20260808 08:45:44.295465 16368 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:44 dist-test-slave-39l8 krb5kdc[16203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178744, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:44.299476 16368 init.cc:377] Logged in from keytab as kudu/127.19.242.193@KRBTEST.COM (short username kudu)
I20260808 08:45:44.301473 16368 webserver.cc:460] Webserver started at http://127.19.242.193:42199/ using document root <none> and password file <none>
I20260808 08:45:44.302502 16368 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:44.302696 16368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:44.303155 16368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:44.306677 16368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "db3c50d7f1d3447c833db4a3b09febd0"
format_stamp: "Formatted at 2026-08-08 08:45:44 on dist-test-slave-39l8"
server_key: "500bddadec438f702327672d8666de1c"
server_key_iv: "15f6e5fd6fc25f92a5be74f21c7b8319"
server_key_version: "encryptionkey@0"
I20260808 08:45:44.307847 16368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "db3c50d7f1d3447c833db4a3b09febd0"
format_stamp: "Formatted at 2026-08-08 08:45:44 on dist-test-slave-39l8"
server_key: "500bddadec438f702327672d8666de1c"
server_key_iv: "15f6e5fd6fc25f92a5be74f21c7b8319"
server_key_version: "encryptionkey@0"
I20260808 08:45:44.314682 16368 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260808 08:45:44.319119 16390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:44.320672 16368 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:45:44.320930 16368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "db3c50d7f1d3447c833db4a3b09febd0"
format_stamp: "Formatted at 2026-08-08 08:45:44 on dist-test-slave-39l8"
server_key: "500bddadec438f702327672d8666de1c"
server_key_iv: "15f6e5fd6fc25f92a5be74f21c7b8319"
server_key_version: "encryptionkey@0"
I20260808 08:45:44.321201 16368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:44.342479 16368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:44.347429 16368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:44.347812 16368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:44.348948 16368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:44.350587 16368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:44.350706 16368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:44.350903 16368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:44.350981 16368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:44.388729 16368 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:46761
I20260808 08:45:44.388783 16549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:46761 every 8 connection(s)
I20260808 08:45:44.390196 16368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:45:44.394420 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 16368
I20260808 08:45:44.394790 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:45:44.395347 20427 external_mini_cluster.cc:1428] Setting key 7a21f787c669a55a090d4d07ac4cf436
Aug 08 08:45:44 dist-test-slave-39l8 krb5kdc[16203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178744, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.193@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:44.416329 16553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:44.393311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:59487 (local address 127.19.242.254:34943)
0808 08:45:44.393852 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:44.393858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:44.395031 (+ 1173us) server_negotiation.cc:407] Connection header received
0808 08:45:44.397423 (+ 2392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:44.397429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:44.397529 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:44.397706 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:44.400099 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:44.400938 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:44.402911 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:44.403417 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:44.403603 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:44.407949 (+ 4346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:44.407958 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:44.407966 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:44.408022 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:44.412146 (+ 4124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:44.413447 (+ 1301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:44.413452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:44.413454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:44.413593 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:44.414235 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:44.414239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:44.414242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:44.414535 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:44.414656 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:44.415774 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0808 08:45:44.416034 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":304,"threads_started":1}
I20260808 08:45:44.418097 16554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:44.393874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:34943 (local address 127.19.242.193:59487)
0808 08:45:44.394826 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:44.394891 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:44.397006 (+ 2115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:44.398152 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:44.398163 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:44.399066 (+ 903us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:44.399858 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:44.399881 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:44.401171 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:44.401176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:44.402654 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:44.402669 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:44.403746 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:44.403755 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:44.404037 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:44.404908 (+ 871us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:44.404941 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:44.407574 (+ 2633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:44.412391 (+ 4817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:44.412401 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:44.412418 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:44.413268 (+ 850us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:44.413775 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:44.413782 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:44.413787 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:44.414103 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:44.414685 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:44.414725 (+ 40us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:44.415260 (+ 535us) client_negotiation.cc:769] Sending connection context
0808 08:45:44.415644 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 08:45:44.416312 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":385,"threads_started":1}
I20260808 08:45:44.420050 16551 heartbeater.cc:347] Connected to a master server at 127.19.242.254:34943
I20260808 08:45:44.420456 16551 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:44.421502 16551 heartbeater.cc:511] Master 127.19.242.254:34943 requested a full tablet report, sending...
I20260808 08:45:44.424119 16272 ts_manager.cc:194] Registered new tserver with Master: db3c50d7f1d3447c833db4a3b09febd0 (127.19.242.193:46761)
I20260808 08:45:44.425841 16272 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.193@KRBTEST.COM'} at 127.19.242.193:59487
WARNING: no policy specified for kudu/127.19.242.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
Entry for principal kudu/127.19.242.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab.
I20260808 08:45:44.478749 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:34943
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:44.855743 16557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:44.856134 16557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:44.856320 16557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:44.864035 16557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:44.864213 16557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:44.864396 16557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:45:44.875767 16557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.194.keytab
--principal=kudu/127.19.242.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:34943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:44.877239 16557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:44.878684 16557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:44.893339 16562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:44.893440 16563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:44.893355 16568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:44.895819 16557 server_base.cc:1034] running on GCE node
I20260808 08:45:44.896533 16557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:44.897562 16557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:44.898850 16557 hybrid_clock.cc:648] HybridClock initialized: now 1786178744898798 us; error 63 us; skew 500 ppm
I20260808 08:45:44.899313 16557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:44 dist-test-slave-39l8 krb5kdc[16203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178744, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:44.902853 16557 init.cc:377] Logged in from keytab as kudu/127.19.242.194@KRBTEST.COM (short username kudu)
I20260808 08:45:44.904663 16557 webserver.cc:460] Webserver started at http://127.19.242.194:39521/ using document root <none> and password file <none>
I20260808 08:45:44.905436 16557 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:44.905548 16557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:44.905831 16557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:44.909102 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "19d6b97d0dc0439188b656ab60bef3f6"
format_stamp: "Formatted at 2026-08-08 08:45:44 on dist-test-slave-39l8"
server_key: "049f96604c97c80990a36a47629a9afa"
server_key_iv: "894c6fa20e6bb70c46cd811764275719"
server_key_version: "encryptionkey@0"
I20260808 08:45:44.909929 16557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "19d6b97d0dc0439188b656ab60bef3f6"
format_stamp: "Formatted at 2026-08-08 08:45:44 on dist-test-slave-39l8"
server_key: "049f96604c97c80990a36a47629a9afa"
server_key_iv: "894c6fa20e6bb70c46cd811764275719"
server_key_version: "encryptionkey@0"
I20260808 08:45:44.916285 16557 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:45:44.920953 16580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:44.922994 16557 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:44.923208 16557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "19d6b97d0dc0439188b656ab60bef3f6"
format_stamp: "Formatted at 2026-08-08 08:45:44 on dist-test-slave-39l8"
server_key: "049f96604c97c80990a36a47629a9afa"
server_key_iv: "894c6fa20e6bb70c46cd811764275719"
server_key_version: "encryptionkey@0"
I20260808 08:45:44.923446 16557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:44.950480 16557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:44.956012 16557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:44.956348 16557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:44.957476 16557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:44.959120 16557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:44.959203 16557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:44.959339 16557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:44.959393 16557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:44.997042 16557 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:37225
I20260808 08:45:44.997100 16747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:37225 every 8 connection(s)
I20260808 08:45:44.998591 16557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:45:45.007238 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 16557
I20260808 08:45:45.007472 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:45:45.007968 20427 external_mini_cluster.cc:1428] Setting key 2eb5bc4a66bde223ba89406d48b0b0d0
Aug 08 08:45:45 dist-test-slave-39l8 krb5kdc[16203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178744, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.194@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:45.026225 16750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.001835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:58749 (local address 127.19.242.254:34943)
0808 08:45:45.002470 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.002476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.003529 (+ 1053us) server_negotiation.cc:407] Connection header received
0808 08:45:45.005761 (+ 2232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.005768 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.005888 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.006035 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:45.008196 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.009311 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.011706 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.012486 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.012672 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.017303 (+ 4631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:45.017313 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:45.017321 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:45.017377 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:45.021592 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.022655 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.022664 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.022670 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.022896 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.023447 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.023455 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.023461 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.023923 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:45.024100 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.025294 (+ 1194us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.025633 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":389,"threads_started":1}
I20260808 08:45:45.027297 16751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.002331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:34943 (local address 127.19.242.194:58749)
0808 08:45:45.003320 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.003381 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.005385 (+ 2004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.006336 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.006347 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.007098 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:45.007919 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.007941 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.009526 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.009532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.011483 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.011501 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.012790 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.012795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.013022 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.013863 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:45.013893 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:45.016957 (+ 3064us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:45.021839 (+ 4882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:45.021848 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:45.021868 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:45.022454 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:45.023040 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:45.023043 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:45.023046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:45.023300 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:45.024172 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:45.024192 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:45.024674 (+ 482us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.025138 (+ 464us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.025715 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":444,"threads_started":1}
I20260808 08:45:45.029417 16748 heartbeater.cc:347] Connected to a master server at 127.19.242.254:34943
I20260808 08:45:45.029817 16748 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:45.030682 16748 heartbeater.cc:511] Master 127.19.242.254:34943 requested a full tablet report, sending...
I20260808 08:45:45.032506 16272 ts_manager.cc:194] Registered new tserver with Master: 19d6b97d0dc0439188b656ab60bef3f6 (127.19.242.194:37225)
I20260808 08:45:45.033479 16272 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.194@KRBTEST.COM'} at 127.19.242.194:58749
WARNING: no policy specified for kudu/127.19.242.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
Entry for principal kudu/127.19.242.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab.
I20260808 08:45:45.090906 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:34943
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:38591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:45:45.430213 16551 heartbeater.cc:503] Master 127.19.242.254:34943 was elected leader, sending a full tablet report...
W20260808 08:45:45.463140 16758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:45.463470 16758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:45.463568 16758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:45.471387 16758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:45.471527 16758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:45.471645 16758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:45:45.482419 16758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:38591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.195.keytab
--principal=kudu/127.19.242.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:34943
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:45.483901 16758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:45.485275 16758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:45.500382 16767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:45.500356 16768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:45.500412 16771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:45.501560 16758 server_base.cc:1034] running on GCE node
I20260808 08:45:45.502254 16758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:45.503466 16758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:45.504679 16758 hybrid_clock.cc:648] HybridClock initialized: now 1786178745504611 us; error 73 us; skew 500 ppm
I20260808 08:45:45.504980 16758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:45 dist-test-slave-39l8 krb5kdc[16203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:45.508656 16758 init.cc:377] Logged in from keytab as kudu/127.19.242.195@KRBTEST.COM (short username kudu)
I20260808 08:45:45.510468 16758 webserver.cc:460] Webserver started at http://127.19.242.195:34311/ using document root <none> and password file <none>
I20260808 08:45:45.511351 16758 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:45.511499 16758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:45.511871 16758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:45.515293 16758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "40e8d4d1027f4040a227fabe4f069417"
format_stamp: "Formatted at 2026-08-08 08:45:45 on dist-test-slave-39l8"
server_key: "fa855fe7908ae82567efe15ca21dabb9"
server_key_iv: "c118054a0348f287197c84dcba0565bb"
server_key_version: "encryptionkey@0"
I20260808 08:45:45.516288 16758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "40e8d4d1027f4040a227fabe4f069417"
format_stamp: "Formatted at 2026-08-08 08:45:45 on dist-test-slave-39l8"
server_key: "fa855fe7908ae82567efe15ca21dabb9"
server_key_iv: "c118054a0348f287197c84dcba0565bb"
server_key_version: "encryptionkey@0"
I20260808 08:45:45.522436 16758 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:45:45.526989 16779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:45.528798 16758 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:45.529098 16758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "40e8d4d1027f4040a227fabe4f069417"
format_stamp: "Formatted at 2026-08-08 08:45:45 on dist-test-slave-39l8"
server_key: "fa855fe7908ae82567efe15ca21dabb9"
server_key_iv: "c118054a0348f287197c84dcba0565bb"
server_key_version: "encryptionkey@0"
I20260808 08:45:45.529335 16758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:45.561352 16758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:45.566131 16758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:45.566465 16758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:45.567621 16758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:45.569149 16758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:45.569229 16758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:45.569321 16758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:45.569376 16758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:45.607599 16758 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:45399
I20260808 08:45:45.607713 16934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:45399 every 8 connection(s)
I20260808 08:45:45.609071 16758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:45:45.619212 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 16758
I20260808 08:45:45.619427 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:45:45.619921 20427 external_mini_cluster.cc:1428] Setting key d0af75cdbaa0c20f4dc5cb7688378193
Aug 08 08:45:45 dist-test-slave-39l8 krb5kdc[16203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178745, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.195@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:45:45.632576 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.611965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:46781 (local address 127.19.242.254:34943)
0808 08:45:45.612514 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.612522 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.613612 (+ 1090us) server_negotiation.cc:407] Connection header received
0808 08:45:45.615668 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.615673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.615764 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.615917 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:45.617650 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.618475 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.620651 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.621104 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.621240 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.625690 (+ 4450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:45.625696 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:45.625699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:45.625738 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:45.628815 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.629791 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.629797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.629799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.629948 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.630518 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.630522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.630524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.630895 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:45.631071 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.631866 (+ 795us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.632135 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":265,"threads_started":1}
I20260808 08:45:45.633805 16939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.612599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:34943 (local address 127.19.242.195:46781)
0808 08:45:45.613413 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.613459 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.615362 (+ 1903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.616193 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.616201 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.616803 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:45.617427 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.617446 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.618678 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.618682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.620463 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.620480 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.621410 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.621437 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.621785 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.622674 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:45:45.622770 (+ 96us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:45.625435 (+ 2665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:45.629009 (+ 3574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:45.629018 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:45.629035 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:45.629603 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:45.630135 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:45:45.630139 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:45:45.630142 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:45:45.630364 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:45:45.631036 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:45.631044 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:45.631457 (+ 413us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.631749 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.632367 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":327,"threads_started":1}
I20260808 08:45:45.635514 16935 heartbeater.cc:347] Connected to a master server at 127.19.242.254:34943
I20260808 08:45:45.635975 16935 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:45.636843 16935 heartbeater.cc:511] Master 127.19.242.254:34943 requested a full tablet report, sending...
I20260808 08:45:45.638466 16272 ts_manager.cc:194] Registered new tserver with Master: 40e8d4d1027f4040a227fabe4f069417 (127.19.242.195:45399)
I20260808 08:45:45.639415 16272 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.242.195@KRBTEST.COM'} at 127.19.242.195:46781
I20260808 08:45:45.648851 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:45:45.668167 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.653639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57064 (local address 127.19.242.254:34943)
0808 08:45:45.653852 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.653857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.654257 (+ 400us) server_negotiation.cc:407] Connection header received
0808 08:45:45.654412 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.654416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.654514 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.654622 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:45.656433 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.657235 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.658673 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.659209 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.659333 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.662068 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:45.662073 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:45.662077 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:45.662163 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:45.665237 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.666077 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.666082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.666085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.666265 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.666672 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.666676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.666678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.667099 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:45.667350 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.667693 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.667913 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:45:45.672905 16272 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:45:45.681604 16272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:45:45.718988 16957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.696047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:46761 (local address 127.0.0.1:46714)
0808 08:45:45.697371 (+ 1324us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.697427 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.697663 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.701689 (+ 4026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.701701 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.701749 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:45.702292 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.702312 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.706858 (+ 4546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.706868 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.712335 (+ 5467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.712371 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.717801 (+ 5430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.717808 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.718050 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.718132 (+ 82us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.718313 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.718554 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":997,"thread_start_us":830,"threads_started":1}
I20260808 08:45:45.720284 16959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.696184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46714 (local address 127.19.242.193:46761)
0808 08:45:45.698560 (+ 2376us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.698585 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.698628 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:45:45.700557 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.700573 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.700972 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.701285 (+ 313us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:45.702598 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.706556 (+ 3958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.712716 (+ 6160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.717519 (+ 4803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.717791 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.718005 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.719641 (+ 1636us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.719885 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2059,"thread_start_us":1880,"threads_started":1}
I20260808 08:45:45.724450 16449 tablet_service.cc:1467] Processing CreateTablet for tablet 8d80369062764a7cb822fc1cf1ade3d6 (DEFAULT_TABLE table=test-table [id=2ee5df8342e94eba9e2a21989b21a485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:45.726399 16449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d80369062764a7cb822fc1cf1ade3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:45.727669 16962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.697052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45080 (local address 127.19.242.194:37225)
0808 08:45:45.718546 (+ 21494us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.718555 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.718590 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:45:45.718725 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.718739 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.719051 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.720476 (+ 1425us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:45.720761 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.722251 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.724753 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.726294 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.726517 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.726731 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.727172 (+ 441us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.727350 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21306,"thread_start_us":21154,"threads_started":1}
I20260808 08:45:45.727731 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.696988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:37225 (local address 127.0.0.1:45080)
0808 08:45:45.716754 (+ 19766us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.716775 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.716903 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.719325 (+ 2422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.719331 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.719367 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:45.720210 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.720228 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.722408 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.722417 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.724523 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.724542 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.726569 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.726578 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.726945 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.726974 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.727099 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.727279 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19606,"mutex_wait_us":1,"thread_start_us":19403,"threads_started":1}
I20260808 08:45:45.728272 16957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.697984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:45399 (local address 127.0.0.1:34082)
0808 08:45:45.719306 (+ 21322us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.719328 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.719431 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.720777 (+ 1346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.720783 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.720819 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:45.721067 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.721079 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.723099 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.723105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.724915 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.724936 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.726861 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.726867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.727066 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.727102 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.727206 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.727376 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21206,"thread_start_us":21545,"threads_started":1}
I20260808 08:45:45.728967 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.698883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34082 (local address 127.19.242.195:45399)
0808 08:45:45.719300 (+ 20417us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.719309 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.719772 (+ 463us) server_negotiation.cc:407] Connection header received
0808 08:45:45.719898 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.719905 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.720205 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.720436 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:45.721271 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.722918 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.725147 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.726387 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.726620 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.726838 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.727547 (+ 709us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.727769 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20243,"thread_start_us":20068,"threads_started":1}
I20260808 08:45:45.732339 16656 tablet_service.cc:1467] Processing CreateTablet for tablet 8d80369062764a7cb822fc1cf1ade3d6 (DEFAULT_TABLE table=test-table [id=2ee5df8342e94eba9e2a21989b21a485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:45.734067 16656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d80369062764a7cb822fc1cf1ade3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:45.734059 16850 tablet_service.cc:1467] Processing CreateTablet for tablet 8d80369062764a7cb822fc1cf1ade3d6 (DEFAULT_TABLE table=test-table [id=2ee5df8342e94eba9e2a21989b21a485]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:45.735443 16850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d80369062764a7cb822fc1cf1ade3d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:45.743588 16966 tablet_bootstrap.cc:492] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Bootstrap starting.
I20260808 08:45:45.747982 16966 tablet_bootstrap.cc:654] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:45.749945 16966 log.cc:824] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:45.750983 16967 tablet_bootstrap.cc:492] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Bootstrap starting.
I20260808 08:45:45.752632 16968 tablet_bootstrap.cc:492] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Bootstrap starting.
I20260808 08:45:45.755224 16967 tablet_bootstrap.cc:654] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:45.756075 16966 tablet_bootstrap.cc:492] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: No bootstrap required, opened a new log
I20260808 08:45:45.756376 16966 ts_tablet_manager.cc:1397] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260808 08:45:45.756526 16968 tablet_bootstrap.cc:654] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:45.756650 16967 log.cc:824] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:45.757860 16968 log.cc:824] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:45.760286 16967 tablet_bootstrap.cc:492] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: No bootstrap required, opened a new log
I20260808 08:45:45.760636 16967 ts_tablet_manager.cc:1397] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 08:45:45.761205 16968 tablet_bootstrap.cc:492] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: No bootstrap required, opened a new log
I20260808 08:45:45.761494 16968 ts_tablet_manager.cc:1397] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260808 08:45:45.765605 16966 raft_consensus.cc:348] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.766105 16966 raft_consensus.cc:374] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:45.766203 16966 raft_consensus.cc:729] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db3c50d7f1d3447c833db4a3b09febd0, State: Initialized, Role: FOLLOWER
I20260808 08:45:45.766971 16966 consensus_queue.cc:260] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.770256 16966 ts_tablet_manager.cc:1428] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260808 08:45:45.772949 16968 raft_consensus.cc:348] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.772949 16967 raft_consensus.cc:348] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.773494 16967 raft_consensus.cc:374] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:45.773494 16968 raft_consensus.cc:374] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:45.773619 16968 raft_consensus.cc:729] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e8d4d1027f4040a227fabe4f069417, State: Initialized, Role: FOLLOWER
I20260808 08:45:45.773613 16967 raft_consensus.cc:729] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19d6b97d0dc0439188b656ab60bef3f6, State: Initialized, Role: FOLLOWER
I20260808 08:45:45.774317 16968 consensus_queue.cc:260] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.774317 16967 consensus_queue.cc:260] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.775794 16935 heartbeater.cc:503] Master 127.19.242.254:34943 was elected leader, sending a full tablet report...
I20260808 08:45:45.776372 16748 heartbeater.cc:503] Master 127.19.242.254:34943 was elected leader, sending a full tablet report...
I20260808 08:45:45.777024 16967 ts_tablet_manager.cc:1428] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260808 08:45:45.777842 16968 ts_tablet_manager.cc:1428] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260808 08:45:45.806602 16974 raft_consensus.cc:482] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:45:45.807063 16974 raft_consensus.cc:504] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.809078 16974 leader_election.cc:288] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e8d4d1027f4040a227fabe4f069417 (127.19.242.195:45399), 19d6b97d0dc0439188b656ab60bef3f6 (127.19.242.194:37225)
I20260808 08:45:45.813694 16978 raft_consensus.cc:482] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:45:45.814049 16978 raft_consensus.cc:504] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.816426 16978 leader_election.cc:288] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db3c50d7f1d3447c833db4a3b09febd0 (127.19.242.193:46761), 19d6b97d0dc0439188b656ab60bef3f6 (127.19.242.194:37225)
I20260808 08:45:45.816757 16980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.809388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:37225 (local address 127.19.242.193:52183)
0808 08:45:45.810132 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.810155 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.810419 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.810835 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.810840 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.810946 (+ 106us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:45.811243 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.811253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.812309 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.812315 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.814026 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.814049 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.815693 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.815700 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.815892 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.815929 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.816043 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.816189 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"spinlock_wait_cycles":28416,"thread_start_us":544,"threads_started":1}
I20260808 08:45:45.817625 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.810088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:46903 (local address 127.19.242.195:45399)
0808 08:45:45.810296 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.810304 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.810811 (+ 507us) server_negotiation.cc:407] Connection header received
0808 08:45:45.811028 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.811031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.811096 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.811207 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:45.811799 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.812541 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.814767 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.816068 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.816238 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.816304 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.817163 (+ 859us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.817350 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:45:45.817855 16962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.809689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:52183 (local address 127.19.242.194:37225)
0808 08:45:45.809926 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.809933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.810274 (+ 341us) server_negotiation.cc:407] Connection header received
0808 08:45:45.810591 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.810605 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.810668 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.810819 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:45.811394 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.812185 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.814207 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.815443 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.815614 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.815704 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.816091 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.816247 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:45:45.818773 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.809504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:45399 (local address 127.19.242.193:46903)
0808 08:45:45.810673 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.810689 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.810874 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.811236 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.811240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.811265 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:45.811639 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.811649 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.812707 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.812712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.814532 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.814550 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.816478 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.816486 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.816780 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.816812 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.818192 (+ 1380us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.818362 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1021,"thread_start_us":810,"threads_started":1}
I20260808 08:45:45.819027 16685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d80369062764a7cb822fc1cf1ade3d6" candidate_uuid: "db3c50d7f1d3447c833db4a3b09febd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19d6b97d0dc0439188b656ab60bef3f6" is_pre_election: true
I20260808 08:45:45.819705 16685 raft_consensus.cc:2454] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db3c50d7f1d3447c833db4a3b09febd0 in term 0.
I20260808 08:45:45.820271 16877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d80369062764a7cb822fc1cf1ade3d6" candidate_uuid: "db3c50d7f1d3447c833db4a3b09febd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e8d4d1027f4040a227fabe4f069417" is_pre_election: true
I20260808 08:45:45.820653 16394 leader_election.cc:302] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19d6b97d0dc0439188b656ab60bef3f6, db3c50d7f1d3447c833db4a3b09febd0; no voters:
I20260808 08:45:45.820808 16877 raft_consensus.cc:2454] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db3c50d7f1d3447c833db4a3b09febd0 in term 0.
I20260808 08:45:45.821192 16974 raft_consensus.cc:2781] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:45:45.821357 16974 raft_consensus.cc:482] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:45:45.821470 16974 raft_consensus.cc:3037] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:45.825030 16974 raft_consensus.cc:504] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.826023 16974 leader_election.cc:288] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [CANDIDATE]: Term 1 election: Requested vote from peers 40e8d4d1027f4040a227fabe4f069417 (127.19.242.195:45399), 19d6b97d0dc0439188b656ab60bef3f6 (127.19.242.194:37225)
I20260808 08:45:45.826483 16877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d80369062764a7cb822fc1cf1ade3d6" candidate_uuid: "db3c50d7f1d3447c833db4a3b09febd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e8d4d1027f4040a227fabe4f069417"
I20260808 08:45:45.826776 16959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.817273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:47891 (local address 127.19.242.193:46761)
0808 08:45:45.817482 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.817491 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.819348 (+ 1857us) server_negotiation.cc:407] Connection header received
0808 08:45:45.819734 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.819742 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.819822 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.819889 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:45.820788 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.821879 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.824428 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.825546 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.825723 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.825804 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.826351 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.826489 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:45:45.826653 16685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d80369062764a7cb822fc1cf1ade3d6" candidate_uuid: "db3c50d7f1d3447c833db4a3b09febd0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19d6b97d0dc0439188b656ab60bef3f6"
I20260808 08:45:45.826766 16877 raft_consensus.cc:3037] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:45.826923 16685 raft_consensus.cc:3037] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:45.827112 16939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.816717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:37225 (local address 127.19.242.195:55357)
0808 08:45:45.817016 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.817038 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.817152 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.819384 (+ 2232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.819389 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.819426 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:45.819652 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.819665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.821499 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.821505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.823876 (+ 2371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.823893 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.825647 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.825653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.825858 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.825909 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.826326 (+ 417us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.826529 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":96,"spinlock_wait_cycles":41216}
I20260808 08:45:45.827646 16985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.817117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:46761 (local address 127.19.242.195:47891)
0808 08:45:45.819246 (+ 2129us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:45.819271 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:45.819529 (+ 258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:45.820084 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:45.820091 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:45.820120 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:45.820598 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.820612 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.822025 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.822032 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.824175 (+ 2143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:45.824190 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.825945 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.825953 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:45.826117 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.826156 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:45:45.826949 (+ 793us) client_negotiation.cc:240] Negotiation successful
0808 08:45:45.827119 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1992,"mutex_wait_us":30,"spinlock_wait_cycles":25472,"thread_start_us":1782,"threads_started":1}
I20260808 08:45:45.828583 16482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d80369062764a7cb822fc1cf1ade3d6" candidate_uuid: "40e8d4d1027f4040a227fabe4f069417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db3c50d7f1d3447c833db4a3b09febd0" is_pre_election: true
I20260808 08:45:45.828984 16962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.817572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:55357 (local address 127.19.242.194:37225)
0808 08:45:45.818163 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.818171 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.818196 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:45:45.818318 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.818325 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.818429 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.818553 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:45.820002 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.821177 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.824091 (+ 2914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.825405 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.825598 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.825685 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.828470 (+ 2785us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.828661 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":3678,"threads_started":1}
I20260808 08:45:45.829135 16482 raft_consensus.cc:2379] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40e8d4d1027f4040a227fabe4f069417 in current term 1: Already voted for candidate db3c50d7f1d3447c833db4a3b09febd0 in this term.
I20260808 08:45:45.829869 16684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d80369062764a7cb822fc1cf1ade3d6" candidate_uuid: "40e8d4d1027f4040a227fabe4f069417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19d6b97d0dc0439188b656ab60bef3f6" is_pre_election: true
I20260808 08:45:45.830547 16877 raft_consensus.cc:2454] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db3c50d7f1d3447c833db4a3b09febd0 in term 1.
I20260808 08:45:45.830564 16685 raft_consensus.cc:2454] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db3c50d7f1d3447c833db4a3b09febd0 in term 1.
I20260808 08:45:45.830919 16784 leader_election.cc:302] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40e8d4d1027f4040a227fabe4f069417; no voters: 19d6b97d0dc0439188b656ab60bef3f6, db3c50d7f1d3447c833db4a3b09febd0
I20260808 08:45:45.831086 16393 leader_election.cc:302] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e8d4d1027f4040a227fabe4f069417, db3c50d7f1d3447c833db4a3b09febd0; no voters:
I20260808 08:45:45.831421 16974 raft_consensus.cc:2781] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:45.831451 16978 raft_consensus.cc:2726] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 08:45:45.831921 16974 raft_consensus.cc:686] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 1 LEADER]: Becoming Leader. State: Replica: db3c50d7f1d3447c833db4a3b09febd0, State: Running, Role: LEADER
I20260808 08:45:45.832445 16974 consensus_queue.cc:237] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } }
I20260808 08:45:45.837651 16271 catalog_manager.cc:5495] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 reported cstate change: term changed from 0 to 1, leader changed from <none> to db3c50d7f1d3447c833db4a3b09febd0 (127.19.242.193). New cstate: current_term: 1 leader_uuid: "db3c50d7f1d3447c833db4a3b09febd0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db3c50d7f1d3447c833db4a3b09febd0" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 46761 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 } health_report { overall_health: UNKNOWN } } }
W20260808 08:45:45.860944 16937 tablet.cc:2369] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:45.868839 16959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.862079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46730 (local address 127.19.242.193:46761)
0808 08:45:45.862322 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.862331 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.862356 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:45:45.862685 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.862690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.862866 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.863161 (+ 295us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:45:45.863630 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.864453 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.866174 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.866661 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.866896 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.867478 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:45:45.868110 (+ 632us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:45:45.868302 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.868394 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.868495 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 08:45:45.878472 16685 raft_consensus.cc:1261] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 1 FOLLOWER]: Refusing update from remote peer db3c50d7f1d3447c833db4a3b09febd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:45.878538 16877 raft_consensus.cc:1261] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 1 FOLLOWER]: Refusing update from remote peer db3c50d7f1d3447c833db4a3b09febd0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:45.879819 16987 consensus_queue.cc:1035] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19d6b97d0dc0439188b656ab60bef3f6" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 37225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:45.880295 16974 consensus_queue.cc:1035] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e8d4d1027f4040a227fabe4f069417" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:45.900604 16993 mvcc.cc:205] Tried to move back new op lower bound from 7316188143105339392 to 7316188142933577728. Current Snapshot: MvccSnapshot[applied={T|T < 7316188143105339392}]
I20260808 08:45:45.901567 16991 mvcc.cc:205] Tried to move back new op lower bound from 7316188143105339392 to 7316188142933577728. Current Snapshot: MvccSnapshot[applied={T|T < 7316188143105339392}]
I20260808 08:45:45.912842 16271 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:45.913199 16271 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:45.918159 16271 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e57196d4ce34405bbf9c5c734e02b95: Sending DeleteTablet for 3 replicas of tablet 8d80369062764a7cb822fc1cf1ade3d6
I20260808 08:45:45.919785 16449 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d80369062764a7cb822fc1cf1ade3d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:45 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:46714
I20260808 08:45:45.919780 16656 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d80369062764a7cb822fc1cf1ade3d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:45 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:45080
I20260808 08:45:45.920392 16850 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d80369062764a7cb822fc1cf1ade3d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:45 UTC) from {username='kudu', principal='kudu/127.19.242.254@KRBTEST.COM'} at 127.0.0.1:34082
I20260808 08:45:45.923879 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 16368
I20260808 08:45:45.932762 17003 tablet_replica.cc:330] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: stopping tablet replica
I20260808 08:45:45.934792 17003 raft_consensus.cc:2229] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:45:45.936031 17003 raft_consensus.cc:2258] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:45.937106 17006 tablet_replica.cc:330] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: stopping tablet replica
I20260808 08:45:45.937544 17006 raft_consensus.cc:2229] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:45.938053 17006 raft_consensus.cc:2258] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:45.940280 17003 ts_tablet_manager.cc:1905] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:45.945765 17007 tablet_replica.cc:330] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: stopping tablet replica
I20260808 08:45:45.946308 17007 raft_consensus.cc:2229] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:45.946914 17007 raft_consensus.cc:2258] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 08:45:45 dist-test-slave-39l8 krb5kdc[16203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.193@KRBTEST.COM
I20260808 08:45:45.949440 17003 ts_tablet_manager.cc:1918] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:45.949528 17007 ts_tablet_manager.cc:1905] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:45.949736 17003 log.cc:1196] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/8d80369062764a7cb822fc1cf1ade3d6
I20260808 08:45:45.950435 17003 ts_tablet_manager.cc:1939] T 8d80369062764a7cb822fc1cf1ade3d6 P db3c50d7f1d3447c833db4a3b09febd0: Deleting consensus metadata
I20260808 08:45:45.953111 17006 ts_tablet_manager.cc:1905] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:45.957662 17007 ts_tablet_manager.cc:1918] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:45.957886 17007 log.cc:1196] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/8d80369062764a7cb822fc1cf1ade3d6
I20260808 08:45:45.958472 17007 ts_tablet_manager.cc:1939] T 8d80369062764a7cb822fc1cf1ade3d6 P 40e8d4d1027f4040a227fabe4f069417: Deleting consensus metadata
I20260808 08:45:45.959407 16959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:45.925030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46734 (local address 127.19.242.193:46761)
0808 08:45:45.927680 (+ 2650us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:45.927689 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:45.933684 (+ 5995us) server_negotiation.cc:407] Connection header received
0808 08:45:45.933956 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:45.933962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:45.934073 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:45.934228 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:45.937741 (+ 3513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.938962 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.941041 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:45.941826 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:45.941992 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:45.948894 (+ 6902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:45.948920 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:45.948941 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:45.949010 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:45.954607 (+ 5597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.955864 (+ 1257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.955875 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.955881 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.956114 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:45.956683 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:45.956689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:45.956693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:45.957273 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:45.957661 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:45.958645 (+ 984us) server_negotiation.cc:299] Negotiation successful
0808 08:45:45.958991 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2428}
I20260808 08:45:45.960781 16252 catalog_manager.cc:4841] TS 40e8d4d1027f4040a227fabe4f069417 (127.19.242.195:45399): tablet 8d80369062764a7cb822fc1cf1ade3d6 (table test-table [id=2ee5df8342e94eba9e2a21989b21a485]) successfully deleted
I20260808 08:45:45.961308 16541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:45.962448 17006 ts_tablet_manager.cc:1918] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:45.962657 17006 log.cc:1196] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/8d80369062764a7cb822fc1cf1ade3d6
I20260808 08:45:45.963407 17006 ts_tablet_manager.cc:1939] T 8d80369062764a7cb822fc1cf1ade3d6 P 19d6b97d0dc0439188b656ab60bef3f6: Deleting consensus metadata
I20260808 08:45:45.965479 16254 catalog_manager.cc:4841] TS 19d6b97d0dc0439188b656ab60bef3f6 (127.19.242.194:37225): tablet 8d80369062764a7cb822fc1cf1ade3d6 (table test-table [id=2ee5df8342e94eba9e2a21989b21a485]) successfully deleted
I20260808 08:45:46.079883 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 16368
I20260808 08:45:46.079988 16252 catalog_manager.cc:4841] TS db3c50d7f1d3447c833db4a3b09febd0 (127.19.242.193:46761): tablet 8d80369062764a7cb822fc1cf1ade3d6 (table test-table [id=2ee5df8342e94eba9e2a21989b21a485]) successfully deleted
I20260808 08:45:46.107622 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 16557
Aug 08 08:45:46 dist-test-slave-39l8 krb5kdc[16203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.194@KRBTEST.COM
I20260808 08:45:46.126068 16962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:46.108593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.19.242.194:37225)
0808 08:45:46.108840 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:46.108844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:46.108866 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:45:46.109085 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:46.109092 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:46.109245 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:46.109345 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:46.110981 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:46.111820 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:46.113389 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:46.113892 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:46.114010 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:46.119148 (+ 5138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:46.119194 (+ 46us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:46.119212 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:46.119261 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:46.122847 (+ 3586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:46.123794 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:46.123803 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:46.123806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:46.123962 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:46.124386 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:46.124389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:46.124392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:46.124826 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:46.125078 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:46.125452 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 08:45:46.125656 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260808 08:45:46.126989 16738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:46.225198 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 16557
I20260808 08:45:46.252468 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 16758
Aug 08 08:45:46 dist-test-slave-39l8 krb5kdc[16203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.195@KRBTEST.COM
I20260808 08:45:46.271459 16965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:46.253537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.19.242.195:45399)
0808 08:45:46.253745 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:46.253750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:46.253769 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:45:46.253834 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:46.253838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:46.253908 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:46.254067 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:46.255582 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:46.256453 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:46.258063 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:46.258538 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:46.258661 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:46.263997 (+ 5336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:46.264017 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:46.264035 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:46.264088 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:46.267875 (+ 3787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:46.269011 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:46.269021 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:46.269024 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:46.269200 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:46.269654 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:46.269658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:46.269660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:46.270107 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:46.270414 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:46.270836 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 08:45:46.271073 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:45:46.272214 16930 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:46.367292 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 16758
I20260808 08:45:46.394601 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 16230
I20260808 08:45:46.395959 16324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:46.511158 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 16230
2026-08-08T08:45:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5178 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T08:45:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:46Z Disabled control of system clock
I20260808 08:45:46.623852 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37843
--webserver_interface=127.19.242.254
--webserver_port=0
--builtin_ntp_servers=127.19.242.212:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:37843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:45:46.996793 17019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:46.997146 17019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:46.997246 17019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:47.005106 17019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:47.005249 17019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:47.005290 17019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:47.005342 17019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:47.005391 17019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:47.015494 17019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:37843
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:37843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:47.016893 17019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:47.018911 17019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:47.032724 17028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:47.032671 17032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:47.032629 17030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:47.033669 17019 server_base.cc:1034] running on GCE node
I20260808 08:45:47.034633 17019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:47.036296 17019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:47.037523 17019 hybrid_clock.cc:648] HybridClock initialized: now 1786178747037480 us; error 34 us; skew 500 ppm
I20260808 08:45:47.037933 17019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:47.040642 17019 webserver.cc:460] Webserver started at http://127.19.242.254:38385/ using document root <none> and password file <none>
I20260808 08:45:47.041460 17019 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:47.041563 17019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:47.041932 17019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:47.045235 17019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "4e1aace2181042fabb4e5a14b5142215"
format_stamp: "Formatted at 2026-08-08 08:45:47 on dist-test-slave-39l8"
server_key: "e8ea9a76adaefedab8d452b4587cef24"
server_key_iv: "916cf218f0c521805971ff9c6c1a7c25"
server_key_version: "encryptionkey@0"
I20260808 08:45:47.046160 17019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "4e1aace2181042fabb4e5a14b5142215"
format_stamp: "Formatted at 2026-08-08 08:45:47 on dist-test-slave-39l8"
server_key: "e8ea9a76adaefedab8d452b4587cef24"
server_key_iv: "916cf218f0c521805971ff9c6c1a7c25"
server_key_version: "encryptionkey@0"
I20260808 08:45:47.052130 17019 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 08:45:47.056453 17039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:47.058458 17019 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:45:47.058825 17019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "4e1aace2181042fabb4e5a14b5142215"
format_stamp: "Formatted at 2026-08-08 08:45:47 on dist-test-slave-39l8"
server_key: "e8ea9a76adaefedab8d452b4587cef24"
server_key_iv: "916cf218f0c521805971ff9c6c1a7c25"
server_key_version: "encryptionkey@0"
I20260808 08:45:47.059123 17019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:47.079000 17019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:47.080122 17019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:47.080504 17019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:47.102967 17019 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:37843
I20260808 08:45:47.102988 17106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:37843 every 8 connection(s)
I20260808 08:45:47.104493 17019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:47.108876 17107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:47.111438 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 17019
I20260808 08:45:47.111639 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:47.112287 20427 external_mini_cluster.cc:1428] Setting key c2c0b05c8784d4f092fe789e7256c50e
I20260808 08:45:47.122311 17107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215: Bootstrap starting.
I20260808 08:45:47.126078 17107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:47.127409 17107 log.cc:824] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:47.127801 17111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:47.114657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47200 (local address 127.19.242.254:37843)
0808 08:45:47.115911 (+ 1254us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:47.115923 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:47.115973 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:45:47.117837 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:47.117865 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:47.118400 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:47.118919 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:47.119613 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:47.120990 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:47.122529 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:47.123402 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:47.123638 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:47.125039 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:47.125055 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:47.125071 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:47.125684 (+ 613us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:47.125787 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:47.125811 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:47.125954 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:47.126215 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 08:45:47.126637 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":434,"threads_started":1}
I20260808 08:45:47.130674 17107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215: No bootstrap required, opened a new log
I20260808 08:45:47.138448 17107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1aace2181042fabb4e5a14b5142215" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37843 } }
I20260808 08:45:47.139014 17107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:47.139145 17107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e1aace2181042fabb4e5a14b5142215, State: Initialized, Role: FOLLOWER
I20260808 08:45:47.139910 17107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1aace2181042fabb4e5a14b5142215" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37843 } }
I20260808 08:45:47.140189 17107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:47.140355 17107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:47.140547 17107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:47.142957 17107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1aace2181042fabb4e5a14b5142215" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37843 } }
I20260808 08:45:47.143532 17107 leader_election.cc:302] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e1aace2181042fabb4e5a14b5142215; no voters:
I20260808 08:45:47.144194 17107 leader_election.cc:288] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:47.144498 17114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:47.145466 17114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [term 1 LEADER]: Becoming Leader. State: Replica: 4e1aace2181042fabb4e5a14b5142215, State: Running, Role: LEADER
I20260808 08:45:47.146037 17114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1aace2181042fabb4e5a14b5142215" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37843 } }
I20260808 08:45:47.146600 17107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:47.150147 17117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e1aace2181042fabb4e5a14b5142215. Latest consensus state: current_term: 1 leader_uuid: "4e1aace2181042fabb4e5a14b5142215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1aace2181042fabb4e5a14b5142215" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37843 } } }
I20260808 08:45:47.151719 17117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:47.150629 17116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e1aace2181042fabb4e5a14b5142215" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e1aace2181042fabb4e5a14b5142215" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 37843 } } }
I20260808 08:45:47.152411 17116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:47.160235 17129 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:47.165484 17129 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:47.175700 17129 catalog_manager.cc:1347] Generated new cluster ID: 7141d0333a8a453b84f567b2ca2c4ea4
I20260808 08:45:47.175854 17129 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:47.192663 17129 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:47.194598 17129 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:47.209342 17129 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215: Generated new TSK 0
I20260808 08:45:47.210583 17129 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:45:47.219058 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.193:0
--local_ip_for_outbound_sockets=127.19.242.193
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37843
--builtin_ntp_servers=127.19.242.212:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:45:47.597298 17139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:47.597676 17139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:47.597846 17139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:47.605487 17139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:47.605659 17139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:47.605834 17139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.193
I20260808 08:45:47.615988 17139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.242.193
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.193
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:47.617424 17139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:47.619488 17139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:47.635372 17146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:47.635320 17148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:47.635987 17150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:47.637050 17139 server_base.cc:1034] running on GCE node
I20260808 08:45:47.637907 17139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:47.639200 17139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:47.640558 17139 hybrid_clock.cc:648] HybridClock initialized: now 1786178747640477 us; error 61 us; skew 500 ppm
I20260808 08:45:47.640980 17139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:47.643846 17139 webserver.cc:460] Webserver started at http://127.19.242.193:43591/ using document root <none> and password file <none>
I20260808 08:45:47.644781 17139 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:47.644937 17139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:47.645316 17139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:47.648958 17139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data/instance:
uuid: "8dafc0ce4e93459d857fb11371769829"
format_stamp: "Formatted at 2026-08-08 08:45:47 on dist-test-slave-39l8"
server_key: "6487ddaa800bd4a2a309a62dc79e3fd1"
server_key_iv: "471dc3acb1a8ff21934f86b58a433d1e"
server_key_version: "encryptionkey@0"
I20260808 08:45:47.649992 17139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance:
uuid: "8dafc0ce4e93459d857fb11371769829"
format_stamp: "Formatted at 2026-08-08 08:45:47 on dist-test-slave-39l8"
server_key: "6487ddaa800bd4a2a309a62dc79e3fd1"
server_key_iv: "471dc3acb1a8ff21934f86b58a433d1e"
server_key_version: "encryptionkey@0"
I20260808 08:45:47.656812 17139 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260808 08:45:47.661412 17159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:47.663372 17139 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:47.663604 17139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal
uuid: "8dafc0ce4e93459d857fb11371769829"
format_stamp: "Formatted at 2026-08-08 08:45:47 on dist-test-slave-39l8"
server_key: "6487ddaa800bd4a2a309a62dc79e3fd1"
server_key_iv: "471dc3acb1a8ff21934f86b58a433d1e"
server_key_version: "encryptionkey@0"
I20260808 08:45:47.663867 17139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:47.681926 17139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:47.683007 17139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:47.683385 17139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:47.684533 17139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:47.686223 17139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:47.686321 17139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:47.686493 17139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:47.686594 17139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:47.724035 17139 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.193:41847
I20260808 08:45:47.724079 17308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.193:41847 every 8 connection(s)
I20260808 08:45:47.725534 17139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/data/info.pb
I20260808 08:45:47.726918 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 17139
I20260808 08:45:47.727126 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal/instance
I20260808 08:45:47.727789 20427 external_mini_cluster.cc:1428] Setting key 4eadf780aa21fe8889238c07edb415fb
I20260808 08:45:47.732038 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.194:0
--local_ip_for_outbound_sockets=127.19.242.194
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37843
--builtin_ntp_servers=127.19.242.212:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:45:47.743878 17311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:47.729192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.193:34219 (local address 127.19.242.254:37843)
0808 08:45:47.729775 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:47.729781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:47.731332 (+ 1551us) server_negotiation.cc:407] Connection header received
0808 08:45:47.734545 (+ 3213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:47.734551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:47.734653 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:47.734861 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:47.736533 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:47.737402 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:47.740251 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:47.740716 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:47.740844 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:47.742885 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:47.742891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:47.742895 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:47.742920 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:47.742971 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:47.742985 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:47.743071 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:47.743471 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 08:45:47.743578 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":281,"threads_started":1}
I20260808 08:45:47.745492 17313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:47.729720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37843 (local address 127.19.242.193:34219)
0808 08:45:47.731115 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:47.731185 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:47.734127 (+ 2942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:47.735165 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:47.735181 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:47.735323 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:47.736280 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:47.736312 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:47.737623 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:47.737637 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:47.740015 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:47.740039 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:47.741006 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:47.741017 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:47.741392 (+ 375us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:47.742374 (+ 982us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:47.742381 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:47.742451 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:47.742577 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:47.743103 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:47.743118 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:47.743130 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:45:47.743358 (+ 228us) client_negotiation.cc:240] Negotiation successful
0808 08:45:47.743909 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":395,"threads_started":1}
I20260808 08:45:47.747447 17309 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37843
I20260808 08:45:47.747855 17309 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:47.748812 17309 heartbeater.cc:511] Master 127.19.242.254:37843 requested a full tablet report, sending...
I20260808 08:45:47.751598 17061 ts_manager.cc:194] Registered new tserver with Master: 8dafc0ce4e93459d857fb11371769829 (127.19.242.193:41847)
I20260808 08:45:47.754330 17061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.193:34219
W20260808 08:45:48.108206 17314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:48.108523 17314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:48.108673 17314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:48.116575 17314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:48.116717 17314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:48.116890 17314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.194
I20260808 08:45:48.126605 17314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.242.194
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.194
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:48.128105 17314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:48.130082 17314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:48.145438 17321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:48.145993 17320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:48.146092 17323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:48.146493 17314 server_base.cc:1034] running on GCE node
I20260808 08:45:48.147351 17314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:48.148540 17314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:48.149803 17314 hybrid_clock.cc:648] HybridClock initialized: now 1786178748149741 us; error 55 us; skew 500 ppm
I20260808 08:45:48.150169 17314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:48.152953 17314 webserver.cc:460] Webserver started at http://127.19.242.194:41867/ using document root <none> and password file <none>
I20260808 08:45:48.153759 17314 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:48.153910 17314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:48.154268 17314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:48.158042 17314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data/instance:
uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d"
format_stamp: "Formatted at 2026-08-08 08:45:48 on dist-test-slave-39l8"
server_key: "4b7e35804aae970cfd2b0903ebc48296"
server_key_iv: "4cb84105050f14829351fc484553d451"
server_key_version: "encryptionkey@0"
I20260808 08:45:48.159076 17314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance:
uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d"
format_stamp: "Formatted at 2026-08-08 08:45:48 on dist-test-slave-39l8"
server_key: "4b7e35804aae970cfd2b0903ebc48296"
server_key_iv: "4cb84105050f14829351fc484553d451"
server_key_version: "encryptionkey@0"
I20260808 08:45:48.165441 17314 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:45:48.169725 17332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:48.171504 17314 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:48.171720 17314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal
uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d"
format_stamp: "Formatted at 2026-08-08 08:45:48 on dist-test-slave-39l8"
server_key: "4b7e35804aae970cfd2b0903ebc48296"
server_key_iv: "4cb84105050f14829351fc484553d451"
server_key_version: "encryptionkey@0"
I20260808 08:45:48.171967 17314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:48.188735 17314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:48.189710 17314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:48.190063 17314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:48.191213 17314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:48.192967 17314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:48.193102 17314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:48.193248 17314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:48.193341 17314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:48.231564 17314 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.194:43553
I20260808 08:45:48.231630 17487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.194:43553 every 8 connection(s)
I20260808 08:45:48.233116 17314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/data/info.pb
I20260808 08:45:48.234875 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 17314
I20260808 08:45:48.235088 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal/instance
I20260808 08:45:48.235564 20427 external_mini_cluster.cc:1428] Setting key 61541faa6084bd26d7012329c1eea8bc
I20260808 08:45:48.238808 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.242.195:0
--local_ip_for_outbound_sockets=127.19.242.195
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37843
--builtin_ntp_servers=127.19.242.212:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:45:48.249938 17311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.236530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:60221 (local address 127.19.242.254:37843)
0808 08:45:48.236741 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.236746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.238889 (+ 2143us) server_negotiation.cc:407] Connection header received
0808 08:45:48.241058 (+ 2169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.241067 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.241181 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.241323 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:48.242856 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.244009 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.246065 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.246886 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.247050 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.248849 (+ 1799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:48.248858 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:48.248865 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:48.248897 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:48.248944 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:48.248963 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:48.249070 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.249385 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.249512 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:45:48.251183 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.237275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37843 (local address 127.19.242.194:60221)
0808 08:45:48.238664 (+ 1389us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:48.238750 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:48.240694 (+ 1944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:48.241669 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:48.241681 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:48.241815 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:48.242562 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.242594 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.244221 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.244226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.245864 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.245881 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.247158 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.247166 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.247417 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.248419 (+ 1002us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:48.248422 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:48.248469 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:48.248570 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:48.249132 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:48.249143 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:48.249150 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:45:48.249337 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 08:45:48.249744 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":509,"threads_started":1}
I20260808 08:45:48.253068 17488 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37843
I20260808 08:45:48.253448 17488 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:48.254406 17488 heartbeater.cc:511] Master 127.19.242.254:37843 requested a full tablet report, sending...
I20260808 08:45:48.256384 17061 ts_manager.cc:194] Registered new tserver with Master: 8f3b4cd6d7a74f3fb846b7cd2220f18d (127.19.242.194:43553)
I20260808 08:45:48.257294 17061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.194:60221
W20260808 08:45:48.625378 17491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:48.625771 17491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:48.625948 17491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:48.633680 17491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:48.633867 17491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:48.634058 17491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.242.195
I20260808 08:45:48.643903 17491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.242.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.242.195
--webserver_port=0
--tserver_master_addrs=127.19.242.254:37843
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.242.195
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:48.645447 17491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:48.647641 17491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:48.662675 17497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:48.662799 17500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:48.662678 17496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:48.663947 17491 server_base.cc:1034] running on GCE node
I20260808 08:45:48.664778 17491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:48.665897 17491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:48.667130 17491 hybrid_clock.cc:648] HybridClock initialized: now 1786178748667062 us; error 50 us; skew 500 ppm
I20260808 08:45:48.667519 17491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:45:48.676313 17491 webserver.cc:460] Webserver started at http://127.19.242.195:45661/ using document root <none> and password file <none>
I20260808 08:45:48.677326 17491 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:48.677464 17491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:48.677834 17491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:48.681231 17491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data/instance:
uuid: "c1963b3fbddb409b8f28a9274fd9684b"
format_stamp: "Formatted at 2026-08-08 08:45:48 on dist-test-slave-39l8"
server_key: "13871f58a923b2116ad75acdf79a5e6e"
server_key_iv: "f488f6485510aa70b5984b1d3f40fd7d"
server_key_version: "encryptionkey@0"
I20260808 08:45:48.682199 17491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance:
uuid: "c1963b3fbddb409b8f28a9274fd9684b"
format_stamp: "Formatted at 2026-08-08 08:45:48 on dist-test-slave-39l8"
server_key: "13871f58a923b2116ad75acdf79a5e6e"
server_key_iv: "f488f6485510aa70b5984b1d3f40fd7d"
server_key_version: "encryptionkey@0"
I20260808 08:45:48.688534 17491 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 08:45:48.693123 17510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:48.695075 17491 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:45:48.695333 17491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal
uuid: "c1963b3fbddb409b8f28a9274fd9684b"
format_stamp: "Formatted at 2026-08-08 08:45:48 on dist-test-slave-39l8"
server_key: "13871f58a923b2116ad75acdf79a5e6e"
server_key_iv: "f488f6485510aa70b5984b1d3f40fd7d"
server_key_version: "encryptionkey@0"
I20260808 08:45:48.695619 17491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:48.708863 17491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:48.709846 17491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:48.710198 17491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:48.711419 17491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:45:48.713179 17491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:45:48.713279 17491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:48.713419 17491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:45:48.713522 17491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:48.752099 17491 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.195:44097
I20260808 08:45:48.752126 17674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.195:44097 every 8 connection(s)
I20260808 08:45:48.753629 17491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/data/info.pb
I20260808 08:45:48.758757 17309 heartbeater.cc:503] Master 127.19.242.254:37843 was elected leader, sending a full tablet report...
I20260808 08:45:48.758863 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 17491
I20260808 08:45:48.759090 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal/instance
I20260808 08:45:48.759714 20427 external_mini_cluster.cc:1428] Setting key 39ad35728309983b40fd70e7ddb07444
I20260808 08:45:48.769589 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.756609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.195:55117 (local address 127.19.242.254:37843)
0808 08:45:48.757202 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.757207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.758724 (+ 1517us) server_negotiation.cc:407] Connection header received
0808 08:45:48.761061 (+ 2337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.761067 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.761160 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.761313 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:48.762855 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.763857 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.765803 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.766331 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.766461 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.768421 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:48.768427 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:48.768431 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:48.768455 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:48.768502 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:48.768516 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:48.768602 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.769091 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.769266 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":303,"threads_started":1}
I20260808 08:45:48.770910 17678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.757346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:37843 (local address 127.19.242.195:55117)
0808 08:45:48.758444 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:48.758498 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:48.760734 (+ 2236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:48.761653 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:48.761667 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:48.761834 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:45:48.762604 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.762626 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.764075 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.764080 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.765550 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.765568 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.766617 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.766623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.766958 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.767840 (+ 882us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:45:48.767844 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:45:48.767914 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:45:48.768089 (+ 175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:45:48.768663 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:45:48.768674 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:45:48.768682 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:45:48.769016 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 08:45:48.769526 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":316,"threads_started":1}
I20260808 08:45:48.772995 17675 heartbeater.cc:347] Connected to a master server at 127.19.242.254:37843
I20260808 08:45:48.773459 17675 heartbeater.cc:464] Registering TS with master...
I20260808 08:45:48.774484 17675 heartbeater.cc:511] Master 127.19.242.254:37843 requested a full tablet report, sending...
I20260808 08:45:48.776417 17060 ts_manager.cc:194] Registered new tserver with Master: c1963b3fbddb409b8f28a9274fd9684b (127.19.242.195:44097)
I20260808 08:45:48.777402 17060 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.242.195:55117
I20260808 08:45:48.789642 20427 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:45:48.801685 17677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.794518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47208 (local address 127.19.242.254:37843)
0808 08:45:48.794760 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.794767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.795431 (+ 664us) server_negotiation.cc:407] Connection header received
0808 08:45:48.795533 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.795537 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.795612 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.795710 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:48.796337 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.797065 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.798534 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.799287 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.799568 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.800891 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:48.800902 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:48.800905 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:48.800929 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:48.800966 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:48.800978 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:48.801084 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.801246 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.801355 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:45:48.806555 17060 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47208:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:45:48.813805 17060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:45:48.840992 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.828792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53290 (local address 127.19.242.195:44097)
0808 08:45:48.829967 (+ 1175us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.829978 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.830784 (+ 806us) server_negotiation.cc:407] Connection header received
0808 08:45:48.830939 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.830946 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.831194 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.831380 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:48.832685 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.834252 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.838413 (+ 4161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.839690 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.839923 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.840183 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.840404 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.840584 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1017,"thread_start_us":871,"threads_started":1}
I20260808 08:45:48.841019 17700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.828130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:44097 (local address 127.0.0.1:53290)
0808 08:45:48.830445 (+ 2315us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:48.830475 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:48.830621 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:48.831792 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:48.831800 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:48.831843 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:48.832414 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.832430 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.834478 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.834488 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.838163 (+ 3675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.838180 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.839908 (+ 1728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.839915 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.840114 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.840167 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:45:48.840347 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 08:45:48.840578 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2187,"mutex_wait_us":378,"thread_start_us":2376,"threads_started":1}
I20260808 08:45:48.843482 17702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.828331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42788 (local address 127.19.242.193:41847)
0808 08:45:48.830517 (+ 2186us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.830539 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.830575 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:45:48.830691 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.830726 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.831020 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.832199 (+ 1179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:48.832540 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.834653 (+ 2113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.839177 (+ 4524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.840763 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.840965 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.841193 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.842838 (+ 1645us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.843089 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1935,"spinlock_wait_cycles":24960,"thread_start_us":1892,"threads_started":1}
I20260808 08:45:48.843788 17696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.827974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:41847 (local address 127.0.0.1:42788)
0808 08:45:48.829026 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:48.829083 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:48.829296 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:48.831326 (+ 2030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:48.831337 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:48.831382 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:48.831903 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.831923 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.834890 (+ 2967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.834899 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.838937 (+ 4038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.838953 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.841738 (+ 2785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.841745 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.842009 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.842057 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 08:45:48.842156 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:45:48.842311 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":895,"thread_start_us":571,"threads_started":1}
I20260808 08:45:48.845530 17704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.830971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.194:43553 (local address 127.0.0.1:34264)
0808 08:45:48.836430 (+ 5459us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:48.836452 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:48.836602 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:48.837898 (+ 1296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:48.837906 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:48.837938 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:48.838349 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.838358 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.840180 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.840185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.842633 (+ 2448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.842651 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.844676 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.844683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.844862 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.844895 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:45:48.844999 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 08:45:48.845139 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5293,"mutex_wait_us":154,"thread_start_us":5108,"threads_started":1}
I20260808 08:45:48.845642 17705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.831335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34264 (local address 127.19.242.194:43553)
0808 08:45:48.837118 (+ 5783us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.837128 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.837166 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:45:48.837275 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.837284 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.837592 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.837837 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:48.838545 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.839995 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.842920 (+ 2925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.844452 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.844636 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.844858 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.845097 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.845274 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5594,"thread_start_us":5951,"threads_started":1}
I20260808 08:45:48.845743 17575 tablet_service.cc:1467] Processing CreateTablet for tablet fbc9af094bcd4f60b9fbe53d37b8b507 (DEFAULT_TABLE table=test-table [id=b131226a8d36477887f3b54039d9bb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:48.847435 17575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc9af094bcd4f60b9fbe53d37b8b507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:48.848006 17220 tablet_service.cc:1467] Processing CreateTablet for tablet fbc9af094bcd4f60b9fbe53d37b8b507 (DEFAULT_TABLE table=test-table [id=b131226a8d36477887f3b54039d9bb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:48.849445 17220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc9af094bcd4f60b9fbe53d37b8b507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:48.850288 17396 tablet_service.cc:1467] Processing CreateTablet for tablet fbc9af094bcd4f60b9fbe53d37b8b507 (DEFAULT_TABLE table=test-table [id=b131226a8d36477887f3b54039d9bb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:45:48.851858 17396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbc9af094bcd4f60b9fbe53d37b8b507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:48.862736 17707 tablet_bootstrap.cc:492] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Bootstrap starting.
I20260808 08:45:48.866132 17707 tablet_bootstrap.cc:654] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:48.867208 17708 tablet_bootstrap.cc:492] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Bootstrap starting.
I20260808 08:45:48.867775 17707 log.cc:824] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:48.869159 17711 tablet_bootstrap.cc:492] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Bootstrap starting.
I20260808 08:45:48.872459 17708 tablet_bootstrap.cc:654] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:48.872731 17711 tablet_bootstrap.cc:654] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:48.873827 17711 log.cc:824] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:48.874120 17708 log.cc:824] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:48.877485 17711 tablet_bootstrap.cc:492] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: No bootstrap required, opened a new log
I20260808 08:45:48.877691 17707 tablet_bootstrap.cc:492] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: No bootstrap required, opened a new log
I20260808 08:45:48.877801 17708 tablet_bootstrap.cc:492] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: No bootstrap required, opened a new log
I20260808 08:45:48.877848 17711 ts_tablet_manager.cc:1397] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260808 08:45:48.877997 17707 ts_tablet_manager.cc:1397] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.003s
I20260808 08:45:48.878047 17708 ts_tablet_manager.cc:1397] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260808 08:45:48.886121 17711 raft_consensus.cc:348] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.886608 17711 raft_consensus.cc:374] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:48.886772 17711 raft_consensus.cc:729] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f3b4cd6d7a74f3fb846b7cd2220f18d, State: Initialized, Role: FOLLOWER
I20260808 08:45:48.887490 17711 consensus_queue.cc:260] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.888774 17488 heartbeater.cc:503] Master 127.19.242.254:37843 was elected leader, sending a full tablet report...
I20260808 08:45:48.889526 17711 ts_tablet_manager.cc:1428] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Time spent starting tablet: real 0.012s user 0.009s sys 0.001s
I20260808 08:45:48.889544 17707 raft_consensus.cc:348] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.889544 17708 raft_consensus.cc:348] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.890043 17707 raft_consensus.cc:374] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:48.890043 17708 raft_consensus.cc:374] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:48.890156 17708 raft_consensus.cc:729] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1963b3fbddb409b8f28a9274fd9684b, State: Initialized, Role: FOLLOWER
I20260808 08:45:48.890163 17707 raft_consensus.cc:729] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dafc0ce4e93459d857fb11371769829, State: Initialized, Role: FOLLOWER
I20260808 08:45:48.890955 17708 consensus_queue.cc:260] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.890991 17707 consensus_queue.cc:260] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.892599 17675 heartbeater.cc:503] Master 127.19.242.254:37843 was elected leader, sending a full tablet report...
I20260808 08:45:48.893215 17707 ts_tablet_manager.cc:1428] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Time spent starting tablet: real 0.015s user 0.013s sys 0.004s
I20260808 08:45:48.894790 17708 ts_tablet_manager.cc:1428] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Time spent starting tablet: real 0.017s user 0.016s sys 0.001s
I20260808 08:45:48.939980 17717 raft_consensus.cc:482] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:45:48.940572 17717 raft_consensus.cc:504] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.942664 17717 leader_election.cc:288] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dafc0ce4e93459d857fb11371769829 (127.19.242.193:41847), c1963b3fbddb409b8f28a9274fd9684b (127.19.242.195:44097)
I20260808 08:45:48.953708 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.943348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:45439 (local address 127.19.242.195:44097)
0808 08:45:48.943552 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.943559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.944301 (+ 742us) server_negotiation.cc:407] Connection header received
0808 08:45:48.944553 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.944557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.944632 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.944710 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:48.945492 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.946844 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.950543 (+ 3699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.952035 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.952253 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.952334 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.953281 (+ 947us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.953443 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:45:48.953708 17702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.943176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.242.194:60617 (local address 127.19.242.193:41847)
0808 08:45:48.943422 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.943431 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.944312 (+ 881us) server_negotiation.cc:407] Connection header received
0808 08:45:48.944881 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.944885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.944948 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.945019 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:45:48.945715 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.946843 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.950558 (+ 3715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.952019 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.952253 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.952340 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:48.953297 (+ 957us) server_negotiation.cc:299] Negotiation successful
0808 08:45:48.953443 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:45:48.953750 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.943042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.195:44097 (local address 127.19.242.194:45439)
0808 08:45:48.944188 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:48.944217 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:48.944385 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:48.944753 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:48.944757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:48.944779 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:48.945242 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.945262 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.947055 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.947144 (+ 89us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.950172 (+ 3028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.950201 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.952431 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.952439 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.952780 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.952939 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 08:45:48.953136 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 08:45:48.953261 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":484,"thread_start_us":504,"threads_started":1}
I20260808 08:45:48.953810 17721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.943034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.193:41847 (local address 127.19.242.194:60617)
0808 08:45:48.944142 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0808 08:45:48.944166 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:45:48.944372 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:45:48.945086 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:45:48.945092 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:45:48.945123 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:45:48.945530 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.945539 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.947055 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.947063 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.950172 (+ 3109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:45:48.950201 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.952422 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:45:48.952432 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:45:48.952781 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:48.952939 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 08:45:48.953081 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:45:48.953261 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"mutex_wait_us":291,"thread_start_us":589,"threads_started":1}
I20260808 08:45:48.955235 17246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc9af094bcd4f60b9fbe53d37b8b507" candidate_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dafc0ce4e93459d857fb11371769829" is_pre_election: true
I20260808 08:45:48.955365 17607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc9af094bcd4f60b9fbe53d37b8b507" candidate_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1963b3fbddb409b8f28a9274fd9684b" is_pre_election: true
I20260808 08:45:48.955878 17246 raft_consensus.cc:2454] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f3b4cd6d7a74f3fb846b7cd2220f18d in term 0.
I20260808 08:45:48.955955 17607 raft_consensus.cc:2454] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f3b4cd6d7a74f3fb846b7cd2220f18d in term 0.
I20260808 08:45:48.956736 17338 leader_election.cc:302] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f3b4cd6d7a74f3fb846b7cd2220f18d, c1963b3fbddb409b8f28a9274fd9684b; no voters:
I20260808 08:45:48.957252 17717 raft_consensus.cc:2781] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:45:48.957433 17717 raft_consensus.cc:482] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:45:48.957559 17717 raft_consensus.cc:3037] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:48.960275 17717 raft_consensus.cc:504] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.961066 17717 leader_election.cc:288] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [CANDIDATE]: Term 1 election: Requested vote from peers 8dafc0ce4e93459d857fb11371769829 (127.19.242.193:41847), c1963b3fbddb409b8f28a9274fd9684b (127.19.242.195:44097)
I20260808 08:45:48.961687 17607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc9af094bcd4f60b9fbe53d37b8b507" candidate_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1963b3fbddb409b8f28a9274fd9684b"
I20260808 08:45:48.961695 17246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbc9af094bcd4f60b9fbe53d37b8b507" candidate_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dafc0ce4e93459d857fb11371769829"
I20260808 08:45:48.961944 17607 raft_consensus.cc:3037] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:48.961954 17246 raft_consensus.cc:3037] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:48.964836 17607 raft_consensus.cc:2454] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f3b4cd6d7a74f3fb846b7cd2220f18d in term 1.
I20260808 08:45:48.964874 17246 raft_consensus.cc:2454] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f3b4cd6d7a74f3fb846b7cd2220f18d in term 1.
I20260808 08:45:48.965421 17338 leader_election.cc:302] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f3b4cd6d7a74f3fb846b7cd2220f18d, c1963b3fbddb409b8f28a9274fd9684b; no voters:
I20260808 08:45:48.965828 17717 raft_consensus.cc:2781] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:48.966416 17717 raft_consensus.cc:686] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 1 LEADER]: Becoming Leader. State: Replica: 8f3b4cd6d7a74f3fb846b7cd2220f18d, State: Running, Role: LEADER
I20260808 08:45:48.967034 17717 consensus_queue.cc:237] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } }
I20260808 08:45:48.972877 17061 catalog_manager.cc:5495] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f3b4cd6d7a74f3fb846b7cd2220f18d (127.19.242.194). New cstate: current_term: 1 leader_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f3b4cd6d7a74f3fb846b7cd2220f18d" member_type: VOTER last_known_addr { host: "127.19.242.194" port: 43553 } health_report { overall_health: HEALTHY } } }
W20260808 08:45:48.978434 17310 tablet.cc:2369] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:45:48.985658 17489 tablet.cc:2369] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:49.002977 17705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:48.996274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.19.242.194:43553)
0808 08:45:48.996531 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:48.996536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:48.996559 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:45:48.996687 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:48.996691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:48.996810 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:48.996965 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:45:48.997425 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:48.998280 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.000183 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:49.000803 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.000930 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:49.001567 (+ 637us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:45:49.002241 (+ 674us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:45:49.002373 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:49.002524 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 08:45:49.002612 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 08:45:49.005615 17676 tablet.cc:2369] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:45:49.012697 17246 raft_consensus.cc:1261] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 1 FOLLOWER]: Refusing update from remote peer 8f3b4cd6d7a74f3fb846b7cd2220f18d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:49.012696 17607 raft_consensus.cc:1261] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 1 FOLLOWER]: Refusing update from remote peer 8f3b4cd6d7a74f3fb846b7cd2220f18d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:45:49.013840 17717 consensus_queue.cc:1035] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1963b3fbddb409b8f28a9274fd9684b" member_type: VOTER last_known_addr { host: "127.19.242.195" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:49.014192 17723 consensus_queue.cc:1035] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dafc0ce4e93459d857fb11371769829" member_type: VOTER last_known_addr { host: "127.19.242.193" port: 41847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:45:49.027635 17726 mvcc.cc:205] Tried to move back new op lower bound from 7316188155944198144 to 7316188155773550592. Current Snapshot: MvccSnapshot[applied={T|T < 7316188155944198144}]
I20260808 08:45:49.029134 17729 mvcc.cc:205] Tried to move back new op lower bound from 7316188155944198144 to 7316188155773550592. Current Snapshot: MvccSnapshot[applied={T|T < 7316188155944198144}]
I20260808 08:45:49.045449 17061 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:49.045815 17061 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47208:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:45:49.050523 17061 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e1aace2181042fabb4e5a14b5142215: Sending DeleteTablet for 3 replicas of tablet fbc9af094bcd4f60b9fbe53d37b8b507
I20260808 08:45:49.051923 17220 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc9af094bcd4f60b9fbe53d37b8b507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:49 UTC) from {username='slave'} at 127.0.0.1:42788
I20260808 08:45:49.052206 17575 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc9af094bcd4f60b9fbe53d37b8b507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:49 UTC) from {username='slave'} at 127.0.0.1:53290
I20260808 08:45:49.053053 17738 tablet_replica.cc:330] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: stopping tablet replica
I20260808 08:45:49.053025 17396 tablet_service.cc:1514] Processing DeleteTablet for tablet fbc9af094bcd4f60b9fbe53d37b8b507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:45:49 UTC) from {username='slave'} at 127.0.0.1:34264
I20260808 08:45:49.053249 17739 tablet_replica.cc:330] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: stopping tablet replica
I20260808 08:45:49.053768 17739 raft_consensus.cc:2229] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:49.054549 17739 raft_consensus.cc:2258] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:49.054839 17738 raft_consensus.cc:2229] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:45:49.055493 17738 raft_consensus.cc:2258] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:49.057842 17739 ts_tablet_manager.cc:1905] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:49.058004 17738 ts_tablet_manager.cc:1905] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:49.060137 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 17139
I20260808 08:45:49.064361 17741 tablet_replica.cc:330] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: stopping tablet replica
I20260808 08:45:49.065130 17741 raft_consensus.cc:2229] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:45:49.066073 17741 raft_consensus.cc:2258] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:45:49.067049 17738 ts_tablet_manager.cc:1918] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:49.067325 17738 log.cc:1196] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-0/wal/wals/fbc9af094bcd4f60b9fbe53d37b8b507
I20260808 08:45:49.067373 17739 ts_tablet_manager.cc:1918] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:49.067582 17739 log.cc:1196] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-2/wal/wals/fbc9af094bcd4f60b9fbe53d37b8b507
I20260808 08:45:49.068003 17738 ts_tablet_manager.cc:1939] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8dafc0ce4e93459d857fb11371769829: Deleting consensus metadata
I20260808 08:45:49.068281 17739 ts_tablet_manager.cc:1939] T fbc9af094bcd4f60b9fbe53d37b8b507 P c1963b3fbddb409b8f28a9274fd9684b: Deleting consensus metadata
I20260808 08:45:49.069216 17741 ts_tablet_manager.cc:1905] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:45:49.070256 17043 catalog_manager.cc:4841] TS 8dafc0ce4e93459d857fb11371769829 (127.19.242.193:41847): tablet fbc9af094bcd4f60b9fbe53d37b8b507 (table test-table [id=b131226a8d36477887f3b54039d9bb57]) successfully deleted
I20260808 08:45:49.070375 17042 catalog_manager.cc:4841] TS c1963b3fbddb409b8f28a9274fd9684b (127.19.242.195:44097): tablet fbc9af094bcd4f60b9fbe53d37b8b507 (table test-table [id=b131226a8d36477887f3b54039d9bb57]) successfully deleted
I20260808 08:45:49.078030 17741 ts_tablet_manager.cc:1918] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:45:49.078322 17741 log.cc:1196] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Deleting WAL directory at /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178398071314-20427-0/minicluster-data/ts-1/wal/wals/fbc9af094bcd4f60b9fbe53d37b8b507
I20260808 08:45:49.078969 17741 ts_tablet_manager.cc:1939] T fbc9af094bcd4f60b9fbe53d37b8b507 P 8f3b4cd6d7a74f3fb846b7cd2220f18d: Deleting consensus metadata
I20260808 08:45:49.080513 17702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:49.061451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42802 (local address 127.19.242.193:41847)
0808 08:45:49.061629 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:49.061635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:49.071351 (+ 9716us) server_negotiation.cc:407] Connection header received
0808 08:45:49.071550 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:49.071556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:49.071687 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:49.071817 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:49.072516 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:49.073639 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.075977 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:49.076674 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.076851 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:49.078400 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:49.078416 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:49.078437 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:49.079462 (+ 1025us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:49.079533 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:49.079564 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:49.079669 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:49.079977 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 08:45:49.080118 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:45:49.080888 17042 catalog_manager.cc:4841] TS 8f3b4cd6d7a74f3fb846b7cd2220f18d (127.19.242.194:43553): tablet fbc9af094bcd4f60b9fbe53d37b8b507 (table test-table [id=b131226a8d36477887f3b54039d9bb57]) successfully deleted
I20260808 08:45:49.081688 17303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:49.200412 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 17139
I20260808 08:45:49.231560 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 17314
I20260808 08:45:49.241567 17705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:49.232738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34294 (local address 127.19.242.194:43553)
0808 08:45:49.232933 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:49.232940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:49.232965 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:45:49.233116 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:49.233124 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:49.233249 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:49.233395 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:49.233910 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:49.235267 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.237272 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:49.238087 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.238256 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:49.239643 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:49.239655 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:49.239675 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:49.240567 (+ 892us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:49.240646 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:49.240675 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:49.240814 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:49.241009 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 08:45:49.241140 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:45:49.242501 17481 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:49.358657 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 17314
I20260808 08:45:49.389441 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 17491
I20260808 08:45:49.396777 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:49.390286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53302 (local address 127.19.242.195:44097)
0808 08:45:49.390460 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:49.390465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:49.390487 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:45:49.390613 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:49.390619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:49.390775 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:49.390874 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:49.391292 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:49.392076 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.393371 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:49.393777 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:49.393893 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:49.395352 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:49.395362 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:49.395390 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:49.396017 (+ 627us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:49.396070 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:49.396093 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:49.396207 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:49.396394 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 08:45:49.396502 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:45:49.397656 17665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:49.488777 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 17491
I20260808 08:45:49.516142 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 17019
I20260808 08:45:49.517465 17102 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:49.630513 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 17019
2026-08-08T08:45:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3113 ms)
[----------] 6 tests from EncryptionPolicyTest (25424 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:49 dist-test-slave-39l8 krb5kdc[17749](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:49 dist-test-slave-39l8 krb5kdc[17749](info): set up 2 sockets
Aug 08 08:45:49 dist-test-slave-39l8 krb5kdc[17749](info): commencing operation
krb5kdc: starting...
W20260808 08:45:50.984057 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:45:51 dist-test-slave-39l8 krb5kdc[17749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:45:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:45:51.354210 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37377
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:51.747089 17767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:51.747506 17767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:51.747684 17767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:51.755412 17767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:51.755601 17767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:51.755725 17767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:51.755841 17767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:51.755921 17767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:51.766556 17767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37377
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:51.768129 17767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:51.769624 17767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:51.783234 17778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:51.783187 17775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:51.783267 17780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:51.784771 17767 server_base.cc:1034] running on GCE node
I20260808 08:45:51.785846 17767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:51.787757 17767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:51.789064 17767 hybrid_clock.cc:648] HybridClock initialized: now 1786178751789005 us; error 87 us; skew 500 ppm
I20260808 08:45:51.789517 17767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:51 dist-test-slave-39l8 krb5kdc[17749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178751, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:51.793430 17767 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:45:51.795428 17767 webserver.cc:460] Webserver started at http://127.0.0.1:44963/ using document root <none> and password file <none>
I20260808 08:45:51.796321 17767 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:51.796502 17767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:51.796880 17767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:51.800629 17767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "ddf6ca5381674b169d709220fee241e5"
format_stamp: "Formatted at 2026-08-08 08:45:51 on dist-test-slave-39l8"
server_key: "f4a645731862fe4c71f3ecb1b6817999"
server_key_iv: "e6209765438ea53a2ef1c9c3bc3c3ca7"
server_key_version: "encryptionkey@0"
I20260808 08:45:51.801673 17767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "ddf6ca5381674b169d709220fee241e5"
format_stamp: "Formatted at 2026-08-08 08:45:51 on dist-test-slave-39l8"
server_key: "f4a645731862fe4c71f3ecb1b6817999"
server_key_iv: "e6209765438ea53a2ef1c9c3bc3c3ca7"
server_key_version: "encryptionkey@0"
I20260808 08:45:51.808403 17767 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 08:45:51.812856 17789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:51.814594 17767 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:45:51.814905 17767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "ddf6ca5381674b169d709220fee241e5"
format_stamp: "Formatted at 2026-08-08 08:45:51 on dist-test-slave-39l8"
server_key: "f4a645731862fe4c71f3ecb1b6817999"
server_key_iv: "e6209765438ea53a2ef1c9c3bc3c3ca7"
server_key_version: "encryptionkey@0"
I20260808 08:45:51.815166 17767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:51.834293 17767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:51.839768 17767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:51.840157 17767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:51.863564 17767 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37377
I20260808 08:45:51.863673 17857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37377 every 8 connection(s)
I20260808 08:45:51.865273 17767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:51.869736 17859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:51.872987 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 17767
I20260808 08:45:51.873281 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:51.874127 20427 external_mini_cluster.cc:1428] Setting key de8c6f593248d4665bd9c69b9cab53b3
I20260808 08:45:51.884380 17859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5: Bootstrap starting.
I20260808 08:45:51.888491 17859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:51.889667 17859 log.cc:824] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:45:51 dist-test-slave-39l8 krb5kdc[17749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:45:51.893383 17859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5: No bootstrap required, opened a new log
I20260808 08:45:51.903375 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:51.876695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47681 (local address 127.0.0.1:37377)
0808 08:45:51.877613 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:51.877627 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:51.877676 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:45:51.879700 (+ 2024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:51.879742 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:51.880419 (+ 677us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:51.880952 (+ 533us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:51.882665 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:51.884777 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:51.886238 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:51.887379 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:51.887583 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:51.893215 (+ 5632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:51.893229 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:51.893249 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:51.893301 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:51.897784 (+ 4483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:51.898848 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:51.898858 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:51.898867 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:51.899142 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:51.899683 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:51.899688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:51.899692 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:51.900541 (+ 849us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:51.900901 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:51.901313 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 08:45:51.901746 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":674,"thread_start_us":429,"threads_started":1}
I20260808 08:45:51.904932 17859 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf6ca5381674b169d709220fee241e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37377 } }
I20260808 08:45:51.905383 17859 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:51.905530 17859 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf6ca5381674b169d709220fee241e5, State: Initialized, Role: FOLLOWER
I20260808 08:45:51.906172 17859 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf6ca5381674b169d709220fee241e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37377 } }
I20260808 08:45:51.906453 17859 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:51.906620 17859 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:51.906875 17859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:51.908859 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:45:51.909709 17859 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf6ca5381674b169d709220fee241e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37377 } }
I20260808 08:45:51.910315 17859 leader_election.cc:302] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddf6ca5381674b169d709220fee241e5; no voters:
I20260808 08:45:51.911058 17859 leader_election.cc:288] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:51.911293 17868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:51.913323 17859 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:51.917928 17868 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [term 1 LEADER]: Becoming Leader. State: Replica: ddf6ca5381674b169d709220fee241e5, State: Running, Role: LEADER
I20260808 08:45:51.919010 17868 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf6ca5381674b169d709220fee241e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37377 } }
I20260808 08:45:51.923668 17870 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddf6ca5381674b169d709220fee241e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf6ca5381674b169d709220fee241e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37377 } } }
I20260808 08:45:51.924238 17870 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:51.925053 17871 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddf6ca5381674b169d709220fee241e5. Latest consensus state: current_term: 1 leader_uuid: "ddf6ca5381674b169d709220fee241e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddf6ca5381674b169d709220fee241e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37377 } } }
I20260808 08:45:51.925561 17871 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:51.932142 17888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:51.938128 17888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:51.950985 17865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:51.931735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35401 (local address 127.0.0.1:37377)
0808 08:45:51.931983 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:51.931992 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:51.932127 (+ 135us) server_negotiation.cc:407] Connection header received
0808 08:45:51.932472 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:51.932478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:51.932556 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:51.932647 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:51.935075 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:51.936378 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:51.938335 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:51.939133 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:51.939270 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:51.943279 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:51.943287 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:51.943292 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:51.943342 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:51.947276 (+ 3934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:51.948345 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:51.948356 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:51.948359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:51.948507 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:51.949104 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:51.949108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:51.949110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:51.949491 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:51.949826 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:51.950347 (+ 521us) server_negotiation.cc:299] Negotiation successful
0808 08:45:51.950543 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 08:45:51.951309 17888 catalog_manager.cc:1347] Generated new cluster ID: 23955b69f0b14d0c9b5c8c0ba13ab1b6
I20260808 08:45:51.951433 17888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:51.984352 17888 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:51.985837 17888 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:52.004384 17888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddf6ca5381674b169d709220fee241e5: Generated new TSK 0
I20260808 08:45:52.005384 17888 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:45:52.020676 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 17767
I20260808 08:45:52.022945 17851 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:52.123636 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 17767
W20260808 08:45:52.151791 17747 connection.cc:535] client connection to 127.0.0.1:37377 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37377): Connection reset by peer (error 104)
2026-08-08T08:45:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2490 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:52 dist-test-slave-39l8 krb5kdc[17902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:52 dist-test-slave-39l8 krb5kdc[17902](info): set up 2 sockets
Aug 08 08:45:52 dist-test-slave-39l8 krb5kdc[17902](info): commencing operation
krb5kdc: starting...
W20260808 08:45:53.532812 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.360s user 0.006s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:45:53 dist-test-slave-39l8 krb5kdc[17902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:45:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:45:53.902797 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36227
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:54.288533 17922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:54.288872 17922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:54.289007 17922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:54.296900 17922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:54.297044 17922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:54.297139 17922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:54.297248 17922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:54.297320 17922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:54.307973 17922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36227
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:54.309456 17922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:54.311060 17922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:54.324385 17928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:54.324308 17932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:54.324345 17929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:54.325443 17922 server_base.cc:1034] running on GCE node
I20260808 08:45:54.326409 17922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:54.328174 17922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:54.329519 17922 hybrid_clock.cc:648] HybridClock initialized: now 1786178754329480 us; error 61 us; skew 500 ppm
I20260808 08:45:54.329919 17922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:54 dist-test-slave-39l8 krb5kdc[17902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178754, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:54.337967 17922 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:45:54.339907 17922 webserver.cc:460] Webserver started at http://127.0.0.1:33791/ using document root <none> and password file <none>
I20260808 08:45:54.340704 17922 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:54.340867 17922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:54.341216 17922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:54.344626 17922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "bf5c4f465b6d4ed18855479c9eee18be"
format_stamp: "Formatted at 2026-08-08 08:45:54 on dist-test-slave-39l8"
server_key: "8a339a21f9bd5660566f28c06bd3343d"
server_key_iv: "bd16f5ab0698427e4b30a29ad4c20cc6"
server_key_version: "encryptionkey@0"
I20260808 08:45:54.345517 17922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "bf5c4f465b6d4ed18855479c9eee18be"
format_stamp: "Formatted at 2026-08-08 08:45:54 on dist-test-slave-39l8"
server_key: "8a339a21f9bd5660566f28c06bd3343d"
server_key_iv: "bd16f5ab0698427e4b30a29ad4c20cc6"
server_key_version: "encryptionkey@0"
I20260808 08:45:54.351572 17922 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 08:45:54.355822 17944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:54.357317 17922 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:45:54.357537 17922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "bf5c4f465b6d4ed18855479c9eee18be"
format_stamp: "Formatted at 2026-08-08 08:45:54 on dist-test-slave-39l8"
server_key: "8a339a21f9bd5660566f28c06bd3343d"
server_key_iv: "bd16f5ab0698427e4b30a29ad4c20cc6"
server_key_version: "encryptionkey@0"
I20260808 08:45:54.357774 17922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:54.384016 17922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:54.389179 17922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:54.389532 17922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:54.410780 17922 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36227
I20260808 08:45:54.410883 18013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36227 every 8 connection(s)
I20260808 08:45:54.412369 17922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:54.416553 18015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:54.420536 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 17922
I20260808 08:45:54.420776 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:54.421360 20427 external_mini_cluster.cc:1428] Setting key a019b00bd3977c4a7c4502ea41f91e17
I20260808 08:45:54.430069 18015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be: Bootstrap starting.
I20260808 08:45:54.433614 18015 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:54.435012 18015 log.cc:824] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:54.436321 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:54.423511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56303 (local address 127.0.0.1:36227)
0808 08:45:54.424361 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:54.424373 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:54.424419 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:45:54.426258 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:54.426286 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:54.426861 (+ 575us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:54.427324 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:54.427978 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:54.429403 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:54.430934 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:54.431668 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:54.431887 (+ 219us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:54.433351 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:54.433359 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:54.433377 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:54.434077 (+ 700us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:54.434174 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:54.434203 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:54.434387 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:54.434740 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 08:45:54.434941 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":369,"threads_started":1}
I20260808 08:45:54.438632 18015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be: No bootstrap required, opened a new log
I20260808 08:45:54.441097 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:45:54.450090 18015 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf5c4f465b6d4ed18855479c9eee18be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260808 08:45:54.450528 18015 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:54.450691 18015 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf5c4f465b6d4ed18855479c9eee18be, State: Initialized, Role: FOLLOWER
I20260808 08:45:54.451512 18015 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf5c4f465b6d4ed18855479c9eee18be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260808 08:45:54.451844 18015 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:54.451996 18015 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:54.452225 18015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:54.454881 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:54.447196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45155 (local address 127.0.0.1:36227)
0808 08:45:54.447433 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:54.447440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:54.447814 (+ 374us) server_negotiation.cc:407] Connection header received
0808 08:45:54.447974 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:54.447980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:54.448072 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:54.448192 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:54.448760 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:54.449866 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:54.451652 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:54.452405 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:54.452557 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:54.453808 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:54.453815 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:54.453822 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:54.453856 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:54.453923 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:54.453945 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:54.454080 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:54.454376 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 08:45:54.454439 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:45:54.455600 18015 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf5c4f465b6d4ed18855479c9eee18be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260808 08:45:54.456292 18015 leader_election.cc:302] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf5c4f465b6d4ed18855479c9eee18be; no voters:
I20260808 08:45:54.457197 18015 leader_election.cc:288] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:54.457370 18033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:54.458112 18033 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [term 1 LEADER]: Becoming Leader. State: Replica: bf5c4f465b6d4ed18855479c9eee18be, State: Running, Role: LEADER
I20260808 08:45:54.458802 18033 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf5c4f465b6d4ed18855479c9eee18be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } }
I20260808 08:45:54.459513 18015 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:54.462337 18038 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf5c4f465b6d4ed18855479c9eee18be. Latest consensus state: current_term: 1 leader_uuid: "bf5c4f465b6d4ed18855479c9eee18be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf5c4f465b6d4ed18855479c9eee18be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } } }
I20260808 08:45:54.462863 18038 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:54.462679 18037 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf5c4f465b6d4ed18855479c9eee18be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf5c4f465b6d4ed18855479c9eee18be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36227 } } }
I20260808 08:45:54.463657 18037 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:54.464673 18043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:54.471458 18043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:54.482087 18043 catalog_manager.cc:1347] Generated new cluster ID: 00fb2e92f87b41a3a57a1e51a7224bff
I20260808 08:45:54.482314 18043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:54.504762 18043 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:54.506824 18043 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:54.518373 18043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf5c4f465b6d4ed18855479c9eee18be: Generated new TSK 0
I20260808 08:45:54.519515 18043 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:45:54.530762 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 17922
W20260808 08:45:54.532382 18009 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56303
W20260808 08:45:54.533344 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 17922: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:45:54.533594 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 17922
W20260808 08:45:54.563721 17900 connection.cc:535] client connection to 127.0.0.1:36227 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36227): Connection reset by peer (error 104)
2026-08-08T08:45:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:54 dist-test-slave-39l8 krb5kdc[18062](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:54 dist-test-slave-39l8 krb5kdc[18062](info): set up 2 sockets
Aug 08 08:45:54 dist-test-slave-39l8 krb5kdc[18062](info): commencing operation
krb5kdc: starting...
W20260808 08:45:55.882272 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.000s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:45:56 dist-test-slave-39l8 krb5kdc[18062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:45:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:45:56.257629 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42775
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:56.635371 18080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:56.635777 18080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:56.635967 18080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:56.643882 18080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:56.644069 18080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:56.644176 18080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:56.644289 18080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:56.644368 18080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:56.655318 18080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:56.656980 18080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:56.658455 18080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:56.671526 18097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:56.671614 18093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:56.671614 18095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:56.673169 18080 server_base.cc:1034] running on GCE node
I20260808 08:45:56.674224 18080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:56.676054 18080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:56.677356 18080 hybrid_clock.cc:648] HybridClock initialized: now 1786178756677322 us; error 51 us; skew 500 ppm
I20260808 08:45:56.677784 18080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:56 dist-test-slave-39l8 krb5kdc[18062](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178756, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:56.681538 18080 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:45:56.683480 18080 webserver.cc:460] Webserver started at http://127.0.0.1:45371/ using document root <none> and password file <none>
I20260808 08:45:56.684263 18080 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:56.684429 18080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:56.684792 18080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:56.688639 18080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "3ad497a4241841b3aac65f82ae57573d"
format_stamp: "Formatted at 2026-08-08 08:45:56 on dist-test-slave-39l8"
server_key: "eb194a541413bbe86c4abffbdaba826d"
server_key_iv: "ebc7d7307732ab7e3178fbef42079477"
server_key_version: "encryptionkey@0"
I20260808 08:45:56.689536 18080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "3ad497a4241841b3aac65f82ae57573d"
format_stamp: "Formatted at 2026-08-08 08:45:56 on dist-test-slave-39l8"
server_key: "eb194a541413bbe86c4abffbdaba826d"
server_key_iv: "ebc7d7307732ab7e3178fbef42079477"
server_key_version: "encryptionkey@0"
I20260808 08:45:56.695817 18080 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 08:45:56.699980 18116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:56.701694 18080 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260808 08:45:56.701946 18080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "3ad497a4241841b3aac65f82ae57573d"
format_stamp: "Formatted at 2026-08-08 08:45:56 on dist-test-slave-39l8"
server_key: "eb194a541413bbe86c4abffbdaba826d"
server_key_iv: "ebc7d7307732ab7e3178fbef42079477"
server_key_version: "encryptionkey@0"
I20260808 08:45:56.702207 18080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:56.708950 18080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:56.713819 18080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:56.714208 18080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:56.735700 18080 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42775
I20260808 08:45:56.735803 18193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42775 every 8 connection(s)
I20260808 08:45:56.737329 18080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:56.738749 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 18080
I20260808 08:45:56.738963 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:56.739532 20427 external_mini_cluster.cc:1428] Setting key c133607e3e3991c2466095d1f090a847
I20260808 08:45:56.743060 18194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:56.748382 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:56.741619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39993 (local address 127.0.0.1:42775)
0808 08:45:56.742537 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:56.742550 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:56.742596 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:45:56.744463 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:56.744489 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:56.744847 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:56.745303 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:56.746513 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:56.746520 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:56.746536 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:56.746558 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:56.746631 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:56.746655 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:56.746973 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:56.747149 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 08:45:56.747357 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":412,"threads_started":1}
I20260808 08:45:56.752717 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:45:56.755765 18194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d: Bootstrap starting.
I20260808 08:45:56.759954 18194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:56.760529 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:56.757672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56523 (local address 127.0.0.1:42775)
0808 08:45:56.757896 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:56.757902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:56.758232 (+ 330us) server_negotiation.cc:407] Connection header received
0808 08:45:56.758440 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:56.758443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:56.758499 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:56.758580 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:56.759718 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:56.759723 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:56.759726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:45:56.759742 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:56.759784 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:45:56.759801 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:56.759901 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:56.760101 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 08:45:56.760170 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:45:56.761509 18194 log.cc:824] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:56.764699 18194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d: No bootstrap required, opened a new log
I20260808 08:45:56.772994 18194 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad497a4241841b3aac65f82ae57573d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42775 } }
I20260808 08:45:56.773494 18194 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:56.773615 18194 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad497a4241841b3aac65f82ae57573d, State: Initialized, Role: FOLLOWER
I20260808 08:45:56.774300 18194 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad497a4241841b3aac65f82ae57573d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42775 } }
I20260808 08:45:56.774554 18194 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:56.774739 18194 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:56.774940 18194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:56.777318 18194 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad497a4241841b3aac65f82ae57573d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42775 } }
I20260808 08:45:56.777968 18194 leader_election.cc:302] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ad497a4241841b3aac65f82ae57573d; no voters:
I20260808 08:45:56.778824 18194 leader_election.cc:288] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:56.778995 18207 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:56.779788 18207 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [term 1 LEADER]: Becoming Leader. State: Replica: 3ad497a4241841b3aac65f82ae57573d, State: Running, Role: LEADER
I20260808 08:45:56.780411 18207 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad497a4241841b3aac65f82ae57573d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42775 } }
I20260808 08:45:56.781277 18194 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:56.783937 18208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ad497a4241841b3aac65f82ae57573d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad497a4241841b3aac65f82ae57573d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42775 } } }
I20260808 08:45:56.783977 18209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ad497a4241841b3aac65f82ae57573d. Latest consensus state: current_term: 1 leader_uuid: "3ad497a4241841b3aac65f82ae57573d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ad497a4241841b3aac65f82ae57573d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42775 } } }
I20260808 08:45:56.784426 18209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:56.784394 18208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:56.787396 18215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:56.793515 18215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:56.804240 18215 catalog_manager.cc:1347] Generated new cluster ID: 6de84251825e446ab10e9561f27cae4c
I20260808 08:45:56.804400 18215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:56.844676 18215 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:56.845212 18215 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:56.855085 18215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ad497a4241841b3aac65f82ae57573d: Generated new TSK 0
I20260808 08:45:56.856175 18215 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:45:56.861747 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18080
W20260808 08:45:56.863397 18186 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39993
W20260808 08:45:56.864192 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18080: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:45:56.864382 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 18080
2026-08-08T08:45:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2330 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:57 dist-test-slave-39l8 krb5kdc[18237](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:57 dist-test-slave-39l8 krb5kdc[18237](info): set up 2 sockets
Aug 08 08:45:57 dist-test-slave-39l8 krb5kdc[18237](info): commencing operation
krb5kdc: starting...
W20260808 08:45:58.256350 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.001s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:45:58 dist-test-slave-39l8 krb5kdc[18237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:45:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:45:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:45:58.626456 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44337
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:45:58.999642 18253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:45:58.999972 18253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:45:59.000068 18253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:45:59.007627 18253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:45:59.007768 18253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:45:59.007817 18253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:45:59.007872 18253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:45:59.007917 18253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:45:59.018354 18253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:45:59.019851 18253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:45:59.021221 18253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:45:59.034763 18263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:59.034680 18264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:45:59.035004 18266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:45:59.035979 18253 server_base.cc:1034] running on GCE node
I20260808 08:45:59.037030 18253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:45:59.038962 18253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:45:59.040234 18253 hybrid_clock.cc:648] HybridClock initialized: now 1786178759040179 us; error 47 us; skew 500 ppm
I20260808 08:45:59.040691 18253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:45:59 dist-test-slave-39l8 krb5kdc[18237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178759, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:45:59.044727 18253 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:45:59.046617 18253 webserver.cc:460] Webserver started at http://127.0.0.1:33495/ using document root <none> and password file <none>
I20260808 08:45:59.047420 18253 fs_manager.cc:359] Metadata directory not provided
I20260808 08:45:59.047586 18253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:45:59.047932 18253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:45:59.051394 18253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "046e38b7c25746feaeb5e18094fe5a9b"
format_stamp: "Formatted at 2026-08-08 08:45:59 on dist-test-slave-39l8"
server_key: "bf12131fc88d5243cb615c6d1518b122"
server_key_iv: "1aae60e73ce9fc2a81d1a381a0ac3cc0"
server_key_version: "encryptionkey@0"
I20260808 08:45:59.052310 18253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "046e38b7c25746feaeb5e18094fe5a9b"
format_stamp: "Formatted at 2026-08-08 08:45:59 on dist-test-slave-39l8"
server_key: "bf12131fc88d5243cb615c6d1518b122"
server_key_iv: "1aae60e73ce9fc2a81d1a381a0ac3cc0"
server_key_version: "encryptionkey@0"
I20260808 08:45:59.058259 18253 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:45:59.062414 18280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:45:59.064121 18253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:45:59.064344 18253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "046e38b7c25746feaeb5e18094fe5a9b"
format_stamp: "Formatted at 2026-08-08 08:45:59 on dist-test-slave-39l8"
server_key: "bf12131fc88d5243cb615c6d1518b122"
server_key_iv: "1aae60e73ce9fc2a81d1a381a0ac3cc0"
server_key_version: "encryptionkey@0"
I20260808 08:45:59.064569 18253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:45:59.092665 18253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:45:59.098655 18253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:45:59.099082 18253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:45:59.122948 18253 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44337
I20260808 08:45:59.122988 18350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44337 every 8 connection(s)
I20260808 08:45:59.124627 18253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:45:59.129084 18351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:45:59.134887 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 18253
I20260808 08:45:59.135134 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:45:59.135680 20427 external_mini_cluster.cc:1428] Setting key 95383935e2a77869e14b76473f329b08
I20260808 08:45:59.141673 18351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b: Bootstrap starting.
I20260808 08:45:59.145960 18351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b: Neither blocks nor log segments found. Creating new log.
I20260808 08:45:59.147248 18351 log.cc:824] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:45:59.150565 18351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b: No bootstrap required, opened a new log
Aug 08 08:45:59 dist-test-slave-39l8 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:45:59.159677 18351 raft_consensus.cc:348] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "046e38b7c25746feaeb5e18094fe5a9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44337 } }
I20260808 08:45:59.160120 18351 raft_consensus.cc:374] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:45:59.160270 18351 raft_consensus.cc:729] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 046e38b7c25746feaeb5e18094fe5a9b, State: Initialized, Role: FOLLOWER
I20260808 08:45:59.161027 18351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "046e38b7c25746feaeb5e18094fe5a9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44337 } }
I20260808 08:45:59.161334 18351 raft_consensus.cc:388] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:45:59.161523 18351 raft_consensus.cc:482] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:45:59.161759 18351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:45:59.162976 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:59.138000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42033 (local address 127.0.0.1:44337)
0808 08:45:59.139083 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:59.139098 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:59.139155 (+ 57us) server_negotiation.cc:407] Connection header received
0808 08:45:59.141111 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:59.141139 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:59.141651 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:59.142151 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:59.144277 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:59.145941 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:59.147605 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:59.148435 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:59.148696 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:59.153962 (+ 5266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:59.153976 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:59.153997 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:59.154060 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:59.157874 (+ 3814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:59.158814 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:59.158822 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:59.158830 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:59.159039 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:59.159512 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:59.159516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:59.159518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:59.160197 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:59.160569 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:59.161094 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 08:45:59.161658 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":786,"thread_start_us":480,"threads_started":1}
I20260808 08:45:59.165151 18351 raft_consensus.cc:504] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "046e38b7c25746feaeb5e18094fe5a9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44337 } }
I20260808 08:45:59.165838 18351 leader_election.cc:302] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 046e38b7c25746feaeb5e18094fe5a9b; no voters:
I20260808 08:45:59.166617 18351 leader_election.cc:288] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:45:59.166795 18359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:45:59.167479 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:45:59.168098 18359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [term 1 LEADER]: Becoming Leader. State: Replica: 046e38b7c25746feaeb5e18094fe5a9b, State: Running, Role: LEADER
I20260808 08:45:59.168844 18359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "046e38b7c25746feaeb5e18094fe5a9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44337 } }
I20260808 08:45:59.169291 18351 sys_catalog.cc:564] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:45:59.177356 18363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 046e38b7c25746feaeb5e18094fe5a9b. Latest consensus state: current_term: 1 leader_uuid: "046e38b7c25746feaeb5e18094fe5a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "046e38b7c25746feaeb5e18094fe5a9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44337 } } }
I20260808 08:45:59.177973 18363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:59.178818 18360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "046e38b7c25746feaeb5e18094fe5a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "046e38b7c25746feaeb5e18094fe5a9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44337 } } }
I20260808 08:45:59.179239 18360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b [sys.catalog]: This master's current role is: LEADER
I20260808 08:45:59.183545 18375 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:45:59.195520 18375 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:45:59.200991 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:45:59.179878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51745 (local address 127.0.0.1:44337)
0808 08:45:59.180124 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:45:59.180152 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 08:45:59.180852 (+ 700us) server_negotiation.cc:407] Connection header received
0808 08:45:59.181089 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:45:59.181097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:45:59.181218 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:45:59.181351 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:45:59.183324 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:59.184726 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:59.187007 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:45:59.188051 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:45:59.188254 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:45:59.192410 (+ 4156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:45:59.192417 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:45:59.192422 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:45:59.192475 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:45:59.196827 (+ 4352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:59.197948 (+ 1121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:59.197957 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:59.197961 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:59.198121 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:45:59.198627 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:45:59.198632 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:45:59.198635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:45:59.199111 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:45:59.199384 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0808 08:45:59.200546 (+ 1162us) server_negotiation.cc:299] Negotiation successful
0808 08:45:59.200726 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:45:59.207917 18375 catalog_manager.cc:1347] Generated new cluster ID: 5162fbc47a884ad2af20165cf41e4f10
I20260808 08:45:59.208056 18375 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:45:59.218573 18375 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:45:59.220041 18375 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:45:59.228896 18375 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 046e38b7c25746feaeb5e18094fe5a9b: Generated new TSK 0
I20260808 08:45:59.229900 18375 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:45:59.236769 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18253
I20260808 08:45:59.238571 18342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:45:59.339704 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 18253
2026-08-08T08:45:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2472 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:45:59 dist-test-slave-39l8 krb5kdc[18398](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:45:59 dist-test-slave-39l8 krb5kdc[18398](info): set up 2 sockets
Aug 08 08:45:59 dist-test-slave-39l8 krb5kdc[18398](info): commencing operation
krb5kdc: starting...
W20260808 08:46:00.696776 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.004s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:00 dist-test-slave-39l8 krb5kdc[18398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:01.070798 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34289
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:01.452382 18415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:01.452723 18415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:01.452894 18415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:01.460532 18415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:01.460680 18415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:01.460772 18415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:01.460892 18415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:01.460961 18415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:01.471936 18415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:01.473506 18415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:01.475070 18415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:01.488306 18421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:01.488270 18422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:01.488330 18426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:01.490015 18415 server_base.cc:1034] running on GCE node
I20260808 08:46:01.491063 18415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:01.492697 18415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:01.493979 18415 hybrid_clock.cc:648] HybridClock initialized: now 1786178761493911 us; error 66 us; skew 500 ppm
I20260808 08:46:01.494410 18415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:01 dist-test-slave-39l8 krb5kdc[18398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178761, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:01.498092 18415 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:01.499914 18415 webserver.cc:460] Webserver started at http://127.0.0.1:46627/ using document root <none> and password file <none>
I20260808 08:46:01.500680 18415 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:01.500797 18415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:01.501065 18415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:01.504637 18415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "566d0b74fea441b58c24bc2d44c5ae4d"
format_stamp: "Formatted at 2026-08-08 08:46:01 on dist-test-slave-39l8"
server_key: "812e13f848e65095094d204a83df0448"
server_key_iv: "2c76f1c9aaab62367f3cd240fb74e7f8"
server_key_version: "encryptionkey@0"
I20260808 08:46:01.505535 18415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "566d0b74fea441b58c24bc2d44c5ae4d"
format_stamp: "Formatted at 2026-08-08 08:46:01 on dist-test-slave-39l8"
server_key: "812e13f848e65095094d204a83df0448"
server_key_iv: "2c76f1c9aaab62367f3cd240fb74e7f8"
server_key_version: "encryptionkey@0"
I20260808 08:46:01.511600 18415 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:46:01.515717 18434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:01.517433 18415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:46:01.517664 18415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "566d0b74fea441b58c24bc2d44c5ae4d"
format_stamp: "Formatted at 2026-08-08 08:46:01 on dist-test-slave-39l8"
server_key: "812e13f848e65095094d204a83df0448"
server_key_iv: "2c76f1c9aaab62367f3cd240fb74e7f8"
server_key_version: "encryptionkey@0"
I20260808 08:46:01.517930 18415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:01.541347 18415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:01.546453 18415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:01.546955 18415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:01.575544 18415 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34289
I20260808 08:46:01.575603 18513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34289 every 8 connection(s)
I20260808 08:46:01.577132 18415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:01.579392 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 18415
I20260808 08:46:01.579656 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:01.580251 20427 external_mini_cluster.cc:1428] Setting key ab0439d262cc7abf23670a60a9f52e62
I20260808 08:46:01.582360 18514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:01.595042 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:01.582487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43529 (local address 127.0.0.1:34289)
0808 08:46:01.583421 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:01.583433 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:01.583477 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:46:01.585151 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:01.585205 (+ 54us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:01.585798 (+ 593us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:01.586328 (+ 530us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:01.586948 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:01.588350 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:01.589781 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:01.590520 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:01.590802 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:01.592237 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:01.592245 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:01.592266 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:01.592905 (+ 639us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:01.592994 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:01.593027 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:01.593239 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:01.593505 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 08:46:01.593825 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":533,"threads_started":1}
I20260808 08:46:01.596705 18514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d: Bootstrap starting.
I20260808 08:46:01.599694 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:01.600525 18514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:01.601698 18514 log.cc:824] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:01.605736 18514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d: No bootstrap required, opened a new log
I20260808 08:46:01.612144 18517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:01.604970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42191 (local address 127.0.0.1:34289)
0808 08:46:01.605264 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:01.605272 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:01.605623 (+ 351us) server_negotiation.cc:407] Connection header received
0808 08:46:01.605882 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:01.605888 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:01.605977 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:01.606112 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:01.606793 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:01.607640 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:01.609131 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:01.609656 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:01.609844 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:01.611211 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:01.611216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:01.611220 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:01.611247 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:01.611298 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:01.611318 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:01.611461 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:01.611641 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 08:46:01.611764 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:46:01.614666 18514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34289 } }
I20260808 08:46:01.615253 18514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:01.615373 18514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 566d0b74fea441b58c24bc2d44c5ae4d, State: Initialized, Role: FOLLOWER
I20260808 08:46:01.616115 18514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34289 } }
I20260808 08:46:01.616437 18514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:01.616642 18514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:01.616833 18514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:01.619405 18514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34289 } }
I20260808 08:46:01.620014 18514 leader_election.cc:302] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 566d0b74fea441b58c24bc2d44c5ae4d; no voters:
I20260808 08:46:01.620735 18514 leader_election.cc:288] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:01.620971 18529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:01.621886 18529 raft_consensus.cc:686] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [term 1 LEADER]: Becoming Leader. State: Replica: 566d0b74fea441b58c24bc2d44c5ae4d, State: Running, Role: LEADER
I20260808 08:46:01.622767 18529 consensus_queue.cc:237] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34289 } }
I20260808 08:46:01.623356 18514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:01.626371 18531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 566d0b74fea441b58c24bc2d44c5ae4d. Latest consensus state: current_term: 1 leader_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34289 } } }
I20260808 08:46:01.627046 18531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:01.626325 18530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "566d0b74fea441b58c24bc2d44c5ae4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34289 } } }
I20260808 08:46:01.627619 18530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:01.630512 18542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:01.636509 18542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:01.649183 18542 catalog_manager.cc:1347] Generated new cluster ID: 30501b1e19fa49f28da746af6f7cd5d6
I20260808 08:46:01.649516 18542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:01.665679 18542 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:01.667359 18542 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:01.674440 18542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 566d0b74fea441b58c24bc2d44c5ae4d: Generated new TSK 0
I20260808 08:46:01.675572 18542 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:01.684626 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18415
W20260808 08:46:01.686043 18508 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43529
W20260808 08:46:01.687304 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18415: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:01.687563 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 18415
2026-08-08T08:46:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2350 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:01 dist-test-slave-39l8 krb5kdc[18561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:01 dist-test-slave-39l8 krb5kdc[18561](info): set up 2 sockets
Aug 08 08:46:01 dist-test-slave-39l8 krb5kdc[18561](info): commencing operation
krb5kdc: starting...
W20260808 08:46:03.061124 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:03 dist-test-slave-39l8 krb5kdc[18561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:03.434398 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36545
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:03.809494 18581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:03.809878 18581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:03.810075 18581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:03.817639 18581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:03.817781 18581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:03.817885 18581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:03.817981 18581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:03.818050 18581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:03.828636 18581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:03.830197 18581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:03.831611 18581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:03.844411 18587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:03.844448 18588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:03.844485 18590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:03.845276 18581 server_base.cc:1034] running on GCE node
I20260808 08:46:03.846206 18581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:03.847900 18581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:03.849157 18581 hybrid_clock.cc:648] HybridClock initialized: now 1786178763849117 us; error 44 us; skew 500 ppm
I20260808 08:46:03.849588 18581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:03 dist-test-slave-39l8 krb5kdc[18561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178763, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:03.853143 18581 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:03.855027 18581 webserver.cc:460] Webserver started at http://127.0.0.1:32785/ using document root <none> and password file <none>
I20260808 08:46:03.855806 18581 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:03.855965 18581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:03.856316 18581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:03.859740 18581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "f35629b1eb914a1599f3975b71b041e2"
format_stamp: "Formatted at 2026-08-08 08:46:03 on dist-test-slave-39l8"
server_key: "94f0e9b4973df30c47968949f17dfcfc"
server_key_iv: "9692fdea82bc1472cc177e3e3f10de0f"
server_key_version: "encryptionkey@0"
I20260808 08:46:03.860639 18581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "f35629b1eb914a1599f3975b71b041e2"
format_stamp: "Formatted at 2026-08-08 08:46:03 on dist-test-slave-39l8"
server_key: "94f0e9b4973df30c47968949f17dfcfc"
server_key_iv: "9692fdea82bc1472cc177e3e3f10de0f"
server_key_version: "encryptionkey@0"
I20260808 08:46:03.866376 18581 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:46:03.870355 18598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:03.871958 18581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:46:03.872201 18581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "f35629b1eb914a1599f3975b71b041e2"
format_stamp: "Formatted at 2026-08-08 08:46:03 on dist-test-slave-39l8"
server_key: "94f0e9b4973df30c47968949f17dfcfc"
server_key_iv: "9692fdea82bc1472cc177e3e3f10de0f"
server_key_version: "encryptionkey@0"
I20260808 08:46:03.872460 18581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:03.879040 18581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:03.883958 18581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:03.884363 18581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:03.904848 18581 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36545
I20260808 08:46:03.904896 18665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36545 every 8 connection(s)
I20260808 08:46:03.906347 18581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:03.910614 18666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:03.911876 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 18581
I20260808 08:46:03.912106 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:03.912570 20427 external_mini_cluster.cc:1428] Setting key bedac39ebd17d9266dbca363db57d6d6
I20260808 08:46:03.922207 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:03.914679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42149 (local address 127.0.0.1:36545)
0808 08:46:03.915690 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:03.915713 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:03.915777 (+ 64us) server_negotiation.cc:407] Connection header received
0808 08:46:03.917986 (+ 2209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:03.918023 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:03.918581 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:03.919128 (+ 547us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:03.920155 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:03.920164 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:03.920181 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:03.920201 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:03.920276 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:03.920309 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:03.920554 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:03.920688 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 08:46:03.920904 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":368,"threads_started":1}
I20260808 08:46:03.926393 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:03.926841 18666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2: Bootstrap starting.
I20260808 08:46:03.930250 18666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:03.931710 18666 log.cc:824] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:03.934540 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:03.931172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34689 (local address 127.0.0.1:36545)
0808 08:46:03.931418 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:03.931427 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:03.931953 (+ 526us) server_negotiation.cc:407] Connection header received
0808 08:46:03.932188 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:03.932192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:03.932297 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:03.932430 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:03.933740 (+ 1310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:03.933755 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:03.933758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:03.933776 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:03.933820 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:03.933836 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:03.933980 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:03.934146 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 08:46:03.934202 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:46:03.935663 18666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2: No bootstrap required, opened a new log
I20260808 08:46:03.943445 18666 raft_consensus.cc:348] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35629b1eb914a1599f3975b71b041e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36545 } }
I20260808 08:46:03.943929 18666 raft_consensus.cc:374] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:03.944051 18666 raft_consensus.cc:729] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35629b1eb914a1599f3975b71b041e2, State: Initialized, Role: FOLLOWER
I20260808 08:46:03.944743 18666 consensus_queue.cc:260] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35629b1eb914a1599f3975b71b041e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36545 } }
I20260808 08:46:03.945020 18666 raft_consensus.cc:388] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:03.945187 18666 raft_consensus.cc:482] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:03.945382 18666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:03.947891 18666 raft_consensus.cc:504] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35629b1eb914a1599f3975b71b041e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36545 } }
I20260808 08:46:03.948509 18666 leader_election.cc:302] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f35629b1eb914a1599f3975b71b041e2; no voters:
I20260808 08:46:03.949198 18666 leader_election.cc:288] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:03.949373 18681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:03.950112 18681 raft_consensus.cc:686] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [term 1 LEADER]: Becoming Leader. State: Replica: f35629b1eb914a1599f3975b71b041e2, State: Running, Role: LEADER
I20260808 08:46:03.950762 18681 consensus_queue.cc:237] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35629b1eb914a1599f3975b71b041e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36545 } }
I20260808 08:46:03.951584 18666 sys_catalog.cc:564] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:03.953670 18682 sys_catalog.cc:455] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f35629b1eb914a1599f3975b71b041e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35629b1eb914a1599f3975b71b041e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36545 } } }
I20260808 08:46:03.953970 18684 sys_catalog.cc:455] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f35629b1eb914a1599f3975b71b041e2. Latest consensus state: current_term: 1 leader_uuid: "f35629b1eb914a1599f3975b71b041e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35629b1eb914a1599f3975b71b041e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36545 } } }
I20260808 08:46:03.954175 18682 sys_catalog.cc:458] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:03.954288 18684 sys_catalog.cc:458] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:03.955240 18691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:03.961858 18691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:03.972311 18691 catalog_manager.cc:1347] Generated new cluster ID: 960661bacc4d49549f2c55dd8ef7cd39
I20260808 08:46:03.972457 18691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:03.999114 18691 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:03.999676 18691 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:04.010288 18691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f35629b1eb914a1599f3975b71b041e2: Generated new TSK 0
I20260808 08:46:04.011315 18691 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:04.020334 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18581
W20260808 08:46:04.021893 18661 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42149
W20260808 08:46:04.022761 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18581: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:04.022921 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 18581
2026-08-08T08:46:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2337 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:04 dist-test-slave-39l8 krb5kdc[18712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:04 dist-test-slave-39l8 krb5kdc[18712](info): set up 2 sockets
Aug 08 08:46:04 dist-test-slave-39l8 krb5kdc[18712](info): commencing operation
krb5kdc: starting...
W20260808 08:46:05.377655 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.002s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:05 dist-test-slave-39l8 krb5kdc[18712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:05.745787 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:06.127143 18733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:06.127543 18733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:06.127735 18733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:06.135435 18733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:06.135640 18733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:06.135763 18733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:06.135879 18733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:06.135950 18733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:06.146529 18733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:06.148078 18733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:06.149569 18733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:06.163029 18749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:06.163391 18745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:06.163501 18744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:06.164007 18733 server_base.cc:1034] running on GCE node
I20260808 08:46:06.165016 18733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:06.166666 18733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:06.167976 18733 hybrid_clock.cc:648] HybridClock initialized: now 1786178766167908 us; error 69 us; skew 500 ppm
I20260808 08:46:06.168377 18733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:06 dist-test-slave-39l8 krb5kdc[18712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178766, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:06.175647 18733 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:06.177577 18733 webserver.cc:460] Webserver started at http://127.0.0.1:38747/ using document root <none> and password file <none>
I20260808 08:46:06.178437 18733 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:06.178632 18733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:06.179039 18733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:06.182839 18733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "dd212c21a4bc4836b984d7d9f63ec46a"
format_stamp: "Formatted at 2026-08-08 08:46:06 on dist-test-slave-39l8"
server_key: "bde606ef5abef3edc2e2f0fbc95d72be"
server_key_iv: "7e2875e8fd077ffc4df7c7ec0fc90ea9"
server_key_version: "encryptionkey@0"
I20260808 08:46:06.183840 18733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "dd212c21a4bc4836b984d7d9f63ec46a"
format_stamp: "Formatted at 2026-08-08 08:46:06 on dist-test-slave-39l8"
server_key: "bde606ef5abef3edc2e2f0fbc95d72be"
server_key_iv: "7e2875e8fd077ffc4df7c7ec0fc90ea9"
server_key_version: "encryptionkey@0"
I20260808 08:46:06.190152 18733 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260808 08:46:06.194543 18756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:06.196183 18733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:46:06.196442 18733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "dd212c21a4bc4836b984d7d9f63ec46a"
format_stamp: "Formatted at 2026-08-08 08:46:06 on dist-test-slave-39l8"
server_key: "bde606ef5abef3edc2e2f0fbc95d72be"
server_key_iv: "7e2875e8fd077ffc4df7c7ec0fc90ea9"
server_key_version: "encryptionkey@0"
I20260808 08:46:06.196687 18733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:06.219596 18733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:06.224339 18733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:06.224673 18733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:06.245949 18733 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45553
I20260808 08:46:06.246086 18834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45553 every 8 connection(s)
I20260808 08:46:06.247524 18733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:06.251778 18835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:06.254117 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 18733
I20260808 08:46:06.254349 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:06.254884 20427 external_mini_cluster.cc:1428] Setting key 97cc2cc57094d9c7e8c8dad1e3775894
I20260808 08:46:06.265481 18835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a: Bootstrap starting.
I20260808 08:46:06.270147 18835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:06.271798 18835 log.cc:824] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:46:06 dist-test-slave-39l8 krb5kdc[18712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:46:06.275677 18835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a: No bootstrap required, opened a new log
I20260808 08:46:06.282466 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:06.257421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:54609 (local address 127.0.0.1:45553)
0808 08:46:06.258427 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:06.258439 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:06.258485 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:46:06.260261 (+ 1776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:06.260287 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:06.260730 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:06.261086 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:06.263155 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:06.264567 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:06.266493 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:06.267549 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:06.267709 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:06.273826 (+ 6117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:06.273835 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:06.273854 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:06.273898 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:06.277341 (+ 3443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:06.278401 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:06.278410 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:06.278418 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:06.278644 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:06.279251 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:06.279255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:06.279257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:06.279874 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:06.280287 (+ 413us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:06.280873 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 08:46:06.281257 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":757,"thread_start_us":503,"threads_started":1}
I20260808 08:46:06.284540 18835 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45553 } }
I20260808 08:46:06.285008 18835 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:06.285164 18835 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd212c21a4bc4836b984d7d9f63ec46a, State: Initialized, Role: FOLLOWER
I20260808 08:46:06.285887 18835 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45553 } }
I20260808 08:46:06.286229 18835 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:06.286417 18835 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:06.286630 18835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:06.287393 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:06.289289 18835 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45553 } }
I20260808 08:46:06.289901 18835 leader_election.cc:302] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd212c21a4bc4836b984d7d9f63ec46a; no voters:
I20260808 08:46:06.290683 18835 leader_election.cc:288] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:06.290894 18845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:06.293146 18835 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:06.297725 18845 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [term 1 LEADER]: Becoming Leader. State: Replica: dd212c21a4bc4836b984d7d9f63ec46a, State: Running, Role: LEADER
I20260808 08:46:06.298679 18845 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45553 } }
I20260808 08:46:06.309459 18851 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd212c21a4bc4836b984d7d9f63ec46a. Latest consensus state: current_term: 1 leader_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45553 } } }
I20260808 08:46:06.309958 18851 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:06.311465 18848 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd212c21a4bc4836b984d7d9f63ec46a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45553 } } }
I20260808 08:46:06.311882 18848 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:06.312635 18869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:06.318581 18869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:06.321023 18838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:06.300756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:39961 (local address 127.0.0.1:45553)
0808 08:46:06.301002 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:06.301013 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:06.301942 (+ 929us) server_negotiation.cc:407] Connection header received
0808 08:46:06.302381 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:06.302392 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:06.302480 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:06.302582 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:06.304987 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:06.306208 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:06.307818 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:06.308825 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:06.309013 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:06.312571 (+ 3558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:06.312579 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:06.312584 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:06.312639 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:06.316853 (+ 4214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:06.318036 (+ 1183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:06.318042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:06.318046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:06.318241 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:06.318994 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:06.319000 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:06.319003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:06.319507 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:06.319845 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:06.320376 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 08:46:06.320605 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 08:46:06.329320 18869 catalog_manager.cc:1347] Generated new cluster ID: 6d71f1d000434d49873c29110715053b
I20260808 08:46:06.329475 18869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:06.349647 18869 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:06.351163 18869 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:06.361405 18869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd212c21a4bc4836b984d7d9f63ec46a: Generated new TSK 0
I20260808 08:46:06.362670 18869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:06.377413 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18733
I20260808 08:46:06.379294 18828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:06.474645 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 18733
W20260808 08:46:06.498971 18710 connection.cc:535] client connection to 127.0.0.1:45553 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45553): Connection reset by peer (error 104)
2026-08-08T08:46:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:06 dist-test-slave-39l8 krb5kdc[18881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:06 dist-test-slave-39l8 krb5kdc[18881](info): set up 2 sockets
Aug 08 08:46:06 dist-test-slave-39l8 krb5kdc[18881](info): commencing operation
krb5kdc: starting...
W20260808 08:46:07.822008 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.003s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:08 dist-test-slave-39l8 krb5kdc[18881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:08.195571 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36637
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:08.578846 18901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:08.579219 18901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:08.579392 18901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:08.587105 18901 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:08.587239 18901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:08.587360 18901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:08.587446 18901 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:08.587512 18901 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:08.598215 18901 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:08.599807 18901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:08.601255 18901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:08.615176 18913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:08.615317 18909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:08.615216 18907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:08.616799 18901 server_base.cc:1034] running on GCE node
I20260808 08:46:08.617772 18901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:08.619581 18901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:08.620820 18901 hybrid_clock.cc:648] HybridClock initialized: now 1786178768620756 us; error 51 us; skew 500 ppm
I20260808 08:46:08.621306 18901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:08 dist-test-slave-39l8 krb5kdc[18881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178768, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:08.625005 18901 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:08.627158 18901 webserver.cc:460] Webserver started at http://127.0.0.1:41303/ using document root <none> and password file <none>
I20260808 08:46:08.627992 18901 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:08.628144 18901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:08.628489 18901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:08.631968 18901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "1260b2c2cd78405280583a0727c9eaec"
format_stamp: "Formatted at 2026-08-08 08:46:08 on dist-test-slave-39l8"
server_key: "1d1b9486eb2b407cb3ce30ba1667c64f"
server_key_iv: "1b6dd7805c008776266f15da6c0bde24"
server_key_version: "encryptionkey@0"
I20260808 08:46:08.632915 18901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "1260b2c2cd78405280583a0727c9eaec"
format_stamp: "Formatted at 2026-08-08 08:46:08 on dist-test-slave-39l8"
server_key: "1d1b9486eb2b407cb3ce30ba1667c64f"
server_key_iv: "1b6dd7805c008776266f15da6c0bde24"
server_key_version: "encryptionkey@0"
I20260808 08:46:08.639394 18901 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:46:08.643469 18921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:08.645294 18901 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:46:08.645553 18901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "1260b2c2cd78405280583a0727c9eaec"
format_stamp: "Formatted at 2026-08-08 08:46:08 on dist-test-slave-39l8"
server_key: "1d1b9486eb2b407cb3ce30ba1667c64f"
server_key_iv: "1b6dd7805c008776266f15da6c0bde24"
server_key_version: "encryptionkey@0"
I20260808 08:46:08.645817 18901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:08.680197 18901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:08.685415 18901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:08.685783 18901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:08.708186 18901 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36637
I20260808 08:46:08.708230 18996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36637 every 8 connection(s)
I20260808 08:46:08.709960 18901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:08.714430 18999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:08.719600 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 18901
I20260808 08:46:08.719851 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:08.720364 20427 external_mini_cluster.cc:1428] Setting key 3731beacc1016a5699e41a903c4dec65
I20260808 08:46:08.729789 18999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec: Bootstrap starting.
I20260808 08:46:08.734323 18999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:08.735845 18999 log.cc:824] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:08.739544 19006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:08.722675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:34819 (local address 127.0.0.1:36637)
0808 08:46:08.723762 (+ 1087us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:08.723782 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:08.723845 (+ 63us) server_negotiation.cc:407] Connection header received
0808 08:46:08.727476 (+ 3631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:08.727522 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:08.728221 (+ 699us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:08.728757 (+ 536us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:08.729385 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:08.731717 (+ 2332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:08.733236 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:08.734468 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:08.734751 (+ 283us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:08.736138 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:08.736152 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:08.736183 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:08.737044 (+ 861us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:08.737140 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:08.737181 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:08.737333 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:08.737732 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 08:46:08.737948 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":465,"threads_started":1}
I20260808 08:46:08.740475 18999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec: No bootstrap required, opened a new log
I20260808 08:46:08.744287 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:08.750142 18999 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1260b2c2cd78405280583a0727c9eaec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36637 } }
I20260808 08:46:08.750825 18999 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:08.750960 18999 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1260b2c2cd78405280583a0727c9eaec, State: Initialized, Role: FOLLOWER
I20260808 08:46:08.751734 18999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1260b2c2cd78405280583a0727c9eaec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36637 } }
I20260808 08:46:08.752038 18999 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:08.752229 18999 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:08.752466 18999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:08.755200 18999 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1260b2c2cd78405280583a0727c9eaec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36637 } }
I20260808 08:46:08.755816 18999 leader_election.cc:302] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1260b2c2cd78405280583a0727c9eaec; no voters:
I20260808 08:46:08.756610 18999 leader_election.cc:288] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:08.756808 19006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:08.749043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:50729 (local address 127.0.0.1:36637)
0808 08:46:08.749295 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:08.749304 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:08.749864 (+ 560us) server_negotiation.cc:407] Connection header received
0808 08:46:08.750131 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:08.750136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:08.750205 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:08.750291 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:08.751045 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:08.752106 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:08.753649 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:08.754141 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:08.754307 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:08.755614 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:08.755620 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:08.755632 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:08.755653 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:08.755715 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:08.755734 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:08.755872 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:08.756363 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 08:46:08.756428 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:46:08.756877 19014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:08.758992 19014 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [term 1 LEADER]: Becoming Leader. State: Replica: 1260b2c2cd78405280583a0727c9eaec, State: Running, Role: LEADER
I20260808 08:46:08.759572 18999 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:08.759768 19014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1260b2c2cd78405280583a0727c9eaec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36637 } }
I20260808 08:46:08.763623 19015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1260b2c2cd78405280583a0727c9eaec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1260b2c2cd78405280583a0727c9eaec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36637 } } }
I20260808 08:46:08.764155 19015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:08.764815 19016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1260b2c2cd78405280583a0727c9eaec. Latest consensus state: current_term: 1 leader_uuid: "1260b2c2cd78405280583a0727c9eaec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1260b2c2cd78405280583a0727c9eaec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36637 } } }
I20260808 08:46:08.765300 19016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:08.771347 19030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:08.776784 19030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:08.786693 19030 catalog_manager.cc:1347] Generated new cluster ID: 60463c435cc140cb861f72ff3311ed3e
I20260808 08:46:08.786901 19030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:08.810812 19030 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:08.813021 19030 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:08.830435 19030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1260b2c2cd78405280583a0727c9eaec: Generated new TSK 0
I20260808 08:46:08.831720 19030 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:08.844801 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18901
W20260808 08:46:08.846302 18989 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.38:34819
W20260808 08:46:08.847349 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 18901: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:08.847543 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 18901
W20260808 08:46:08.876400 18877 connection.cc:535] client connection to 127.0.0.1:36637 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36637): Connection reset by peer (error 104)
2026-08-08T08:46:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2377 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:08 dist-test-slave-39l8 krb5kdc[19046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:08 dist-test-slave-39l8 krb5kdc[19046](info): set up 2 sockets
Aug 08 08:46:08 dist-test-slave-39l8 krb5kdc[19046](info): commencing operation
krb5kdc: starting...
W20260808 08:46:10.203769 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.003s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:10 dist-test-slave-39l8 krb5kdc[19046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:10.575109 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38279
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:10.957659 19065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:10.958014 19065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:10.958209 19065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:10.966338 19065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:10.966480 19065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:10.966574 19065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:10.966699 19065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:10.966805 19065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:10.977474 19065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:10.979051 19065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:10.980494 19065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:10.993649 19070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:10.993695 19071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:10.993737 19074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:10.994423 19065 server_base.cc:1034] running on GCE node
I20260808 08:46:10.995399 19065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:10.997071 19065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:10.998337 19065 hybrid_clock.cc:648] HybridClock initialized: now 1786178770998288 us; error 49 us; skew 500 ppm
I20260808 08:46:10.998936 19065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:10 dist-test-slave-39l8 krb5kdc[19046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178770, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:11.003293 19065 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:11.005141 19065 webserver.cc:460] Webserver started at http://127.0.0.1:39935/ using document root <none> and password file <none>
I20260808 08:46:11.005968 19065 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:11.006114 19065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:11.006475 19065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:11.009817 19065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "b423e37d1054451dbf6eda879d71ce09"
format_stamp: "Formatted at 2026-08-08 08:46:11 on dist-test-slave-39l8"
server_key: "a529f54aff1c3d175d7813c8e4e710d3"
server_key_iv: "6e794f1f3bdc4360a48439e9b6b95de1"
server_key_version: "encryptionkey@0"
I20260808 08:46:11.010668 19065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "b423e37d1054451dbf6eda879d71ce09"
format_stamp: "Formatted at 2026-08-08 08:46:11 on dist-test-slave-39l8"
server_key: "a529f54aff1c3d175d7813c8e4e710d3"
server_key_iv: "6e794f1f3bdc4360a48439e9b6b95de1"
server_key_version: "encryptionkey@0"
I20260808 08:46:11.016692 19065 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:46:11.020572 19081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:11.022262 19065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:46:11.022491 19065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "b423e37d1054451dbf6eda879d71ce09"
format_stamp: "Formatted at 2026-08-08 08:46:11 on dist-test-slave-39l8"
server_key: "a529f54aff1c3d175d7813c8e4e710d3"
server_key_iv: "6e794f1f3bdc4360a48439e9b6b95de1"
server_key_version: "encryptionkey@0"
I20260808 08:46:11.022756 19065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:11.029536 19065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:11.034227 19065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:11.034567 19065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:11.055452 19065 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38279
I20260808 08:46:11.055492 19158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38279 every 8 connection(s)
I20260808 08:46:11.056974 19065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:11.061009 19159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:11.062256 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 19065
I20260808 08:46:11.062484 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:11.063112 20427 external_mini_cluster.cc:1428] Setting key 8f03df60d536173d775239e2cecd3af9
I20260808 08:46:11.071664 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:11.065164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:56089 (local address 127.0.0.1:38279)
0808 08:46:11.066051 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:11.066063 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:11.066111 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:46:11.067925 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:11.067951 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:11.068354 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:11.068722 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:11.069927 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:11.069934 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:11.069947 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:11.069964 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:11.070026 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:11.070049 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:11.070273 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:11.070382 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 08:46:11.070622 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":414,"threads_started":1}
I20260808 08:46:11.075703 19159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09: Bootstrap starting.
I20260808 08:46:11.075810 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:11.080148 19159 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:11.081671 19159 log.cc:824] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:11.084754 19165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:11.081839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:50391 (local address 127.0.0.1:38279)
0808 08:46:11.082063 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:11.082068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:11.082514 (+ 446us) server_negotiation.cc:407] Connection header received
0808 08:46:11.082758 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:11.082767 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:11.082846 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:11.082987 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:11.084026 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:11.084031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:11.084037 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:11.084059 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:11.084110 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:11.084133 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:11.084279 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:11.084342 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 08:46:11.084418 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:46:11.085691 19159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09: No bootstrap required, opened a new log
I20260808 08:46:11.094409 19159 raft_consensus.cc:348] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b423e37d1054451dbf6eda879d71ce09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38279 } }
I20260808 08:46:11.095001 19159 raft_consensus.cc:374] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:11.095139 19159 raft_consensus.cc:729] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b423e37d1054451dbf6eda879d71ce09, State: Initialized, Role: FOLLOWER
I20260808 08:46:11.095933 19159 consensus_queue.cc:260] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b423e37d1054451dbf6eda879d71ce09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38279 } }
I20260808 08:46:11.096235 19159 raft_consensus.cc:388] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:11.096413 19159 raft_consensus.cc:482] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:11.096621 19159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:11.099519 19159 raft_consensus.cc:504] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b423e37d1054451dbf6eda879d71ce09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38279 } }
I20260808 08:46:11.100144 19159 leader_election.cc:302] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b423e37d1054451dbf6eda879d71ce09; no voters:
I20260808 08:46:11.100883 19159 leader_election.cc:288] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:11.101071 19173 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:11.101843 19173 raft_consensus.cc:686] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [term 1 LEADER]: Becoming Leader. State: Replica: b423e37d1054451dbf6eda879d71ce09, State: Running, Role: LEADER
I20260808 08:46:11.102923 19173 consensus_queue.cc:237] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b423e37d1054451dbf6eda879d71ce09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38279 } }
I20260808 08:46:11.103593 19159 sys_catalog.cc:564] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:11.105986 19177 sys_catalog.cc:455] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b423e37d1054451dbf6eda879d71ce09. Latest consensus state: current_term: 1 leader_uuid: "b423e37d1054451dbf6eda879d71ce09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b423e37d1054451dbf6eda879d71ce09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38279 } } }
I20260808 08:46:11.106086 19176 sys_catalog.cc:455] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b423e37d1054451dbf6eda879d71ce09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b423e37d1054451dbf6eda879d71ce09" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38279 } } }
I20260808 08:46:11.106459 19176 sys_catalog.cc:458] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:11.106457 19177 sys_catalog.cc:458] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:11.108346 19181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:11.115357 19181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:11.125643 19181 catalog_manager.cc:1347] Generated new cluster ID: bc79e0fd01ea45fba4c37a2892b7481b
I20260808 08:46:11.125802 19181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:11.150260 19181 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:11.150930 19181 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:11.165179 19181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b423e37d1054451dbf6eda879d71ce09: Generated new TSK 0
I20260808 08:46:11.166162 19181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:11.174062 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19065
W20260808 08:46:11.175447 19151 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.38:56089
W20260808 08:46:11.176286 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19065: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:11.176458 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 19065
2026-08-08T08:46:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2329 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:11 dist-test-slave-39l8 krb5kdc[19205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:11 dist-test-slave-39l8 krb5kdc[19205](info): set up 2 sockets
Aug 08 08:46:11 dist-test-slave-39l8 krb5kdc[19205](info): commencing operation
krb5kdc: starting...
W20260808 08:46:12.637497 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.411s user 0.007s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:12 dist-test-slave-39l8 krb5kdc[19205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:13.028718 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:13.411266 19219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:13.411715 19219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:13.411893 19219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:13.419497 19219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:13.419703 19219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:13.419826 19219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:13.419950 19219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:13.420037 19219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:13.430886 19219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:13.432507 19219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:13.434072 19219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:13.448314 19225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:13.448554 19224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:13.448549 19227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:13.449733 19219 server_base.cc:1034] running on GCE node
I20260808 08:46:13.450804 19219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:13.452668 19219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:13.453975 19219 hybrid_clock.cc:648] HybridClock initialized: now 1786178773453913 us; error 66 us; skew 500 ppm
I20260808 08:46:13.454443 19219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:13 dist-test-slave-39l8 krb5kdc[19205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178773, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:13.458367 19219 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:13.460282 19219 webserver.cc:460] Webserver started at http://127.0.0.1:44079/ using document root <none> and password file <none>
I20260808 08:46:13.461108 19219 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:13.461288 19219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:13.461640 19219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:13.465137 19219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "d6ee5676cd1e469fa6d2481ad7593ce4"
format_stamp: "Formatted at 2026-08-08 08:46:13 on dist-test-slave-39l8"
server_key: "46476a8c97e64e270f8f37db5ccf51a5"
server_key_iv: "4278ce6a03f67867a0c333358d17085c"
server_key_version: "encryptionkey@0"
I20260808 08:46:13.466102 19219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "d6ee5676cd1e469fa6d2481ad7593ce4"
format_stamp: "Formatted at 2026-08-08 08:46:13 on dist-test-slave-39l8"
server_key: "46476a8c97e64e270f8f37db5ccf51a5"
server_key_iv: "4278ce6a03f67867a0c333358d17085c"
server_key_version: "encryptionkey@0"
I20260808 08:46:13.472357 19219 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260808 08:46:13.476936 19237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:13.478822 19219 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:46:13.479072 19219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "d6ee5676cd1e469fa6d2481ad7593ce4"
format_stamp: "Formatted at 2026-08-08 08:46:13 on dist-test-slave-39l8"
server_key: "46476a8c97e64e270f8f37db5ccf51a5"
server_key_iv: "4278ce6a03f67867a0c333358d17085c"
server_key_version: "encryptionkey@0"
I20260808 08:46:13.479354 19219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:13.502894 19219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:13.507867 19219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:13.508210 19219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:13.529242 19219 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46145
I20260808 08:46:13.529301 19316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46145 every 8 connection(s)
I20260808 08:46:13.530812 19219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:13.535045 19317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:13.538317 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 19219
I20260808 08:46:13.538547 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:13.539143 20427 external_mini_cluster.cc:1428] Setting key 6c6d40a6bdcc640d25a51df176e57b8f
I20260808 08:46:13.547914 19317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4: Bootstrap starting.
I20260808 08:46:13.551370 19317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:13.552520 19317 log.cc:824] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:46:13 dist-test-slave-39l8 krb5kdc[19205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178772, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:46:13.556495 19317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4: No bootstrap required, opened a new log
I20260808 08:46:13.566253 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:13.541296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:54985 (local address 127.0.0.1:46145)
0808 08:46:13.542200 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:13.542214 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:13.542263 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:46:13.544176 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:13.544204 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:13.544737 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:13.545195 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:13.546886 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:13.548342 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:13.549692 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:13.550394 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:13.550616 (+ 222us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:13.555888 (+ 5272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:13.555902 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:13.555927 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:13.555978 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:13.560536 (+ 4558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:13.561689 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:13.561699 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:13.561710 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:13.561942 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:13.562519 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:13.562529 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:13.562534 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:13.563419 (+ 885us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:13.563778 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:13.564289 (+ 511us) server_negotiation.cc:299] Negotiation successful
0808 08:46:13.564708 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":414,"threads_started":1}
I20260808 08:46:13.567991 19317 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46145 } }
I20260808 08:46:13.568460 19317 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:13.568595 19317 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6ee5676cd1e469fa6d2481ad7593ce4, State: Initialized, Role: FOLLOWER
I20260808 08:46:13.569272 19317 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46145 } }
I20260808 08:46:13.569566 19317 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:13.569758 19317 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:13.569963 19317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:13.571105 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:13.573251 19317 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46145 } }
I20260808 08:46:13.573930 19317 leader_election.cc:302] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6ee5676cd1e469fa6d2481ad7593ce4; no voters:
I20260808 08:46:13.574699 19317 leader_election.cc:288] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:13.574846 19324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:13.576815 19324 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [term 1 LEADER]: Becoming Leader. State: Replica: d6ee5676cd1e469fa6d2481ad7593ce4, State: Running, Role: LEADER
I20260808 08:46:13.577569 19324 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46145 } }
I20260808 08:46:13.577797 19317 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:13.584535 19333 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6ee5676cd1e469fa6d2481ad7593ce4. Latest consensus state: current_term: 1 leader_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46145 } } }
I20260808 08:46:13.585008 19333 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:13.585716 19330 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6ee5676cd1e469fa6d2481ad7593ce4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46145 } } }
I20260808 08:46:13.586086 19330 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:13.594902 19345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:13.601194 19345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:13.607694 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:13.578790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:54463 (local address 127.0.0.1:46145)
0808 08:46:13.578982 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:13.578988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:13.584896 (+ 5908us) server_negotiation.cc:407] Connection header received
0808 08:46:13.585415 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:13.585425 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:13.585540 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:13.585637 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:13.588833 (+ 3196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:13.590424 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:13.593289 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:13.594094 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:13.594276 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:13.598414 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:13.598422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:13.598427 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:13.598477 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:13.602590 (+ 4113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:13.604023 (+ 1433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:13.604044 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:13.604048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:13.604222 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:13.604863 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:13.604868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:13.604871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:13.605354 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:13.605647 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:13.607045 (+ 1398us) server_negotiation.cc:299] Negotiation successful
0808 08:46:13.607285 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:46:13.614631 19345 catalog_manager.cc:1347] Generated new cluster ID: 92bf14ed458546589fc1b77a0f74371b
I20260808 08:46:13.614815 19345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:13.636456 19345 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:13.637919 19345 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:13.647225 19345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6ee5676cd1e469fa6d2481ad7593ce4: Generated new TSK 0
I20260808 08:46:13.648301 19345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:13.657856 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19219
I20260808 08:46:13.659267 19309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:13.754748 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 19219
W20260808 08:46:13.785653 19203 connection.cc:535] client connection to 127.0.0.1:46145 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46145): Connection reset by peer (error 104)
2026-08-08T08:46:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:13 dist-test-slave-39l8 krb5kdc[19366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:13 dist-test-slave-39l8 krb5kdc[19366](info): set up 2 sockets
Aug 08 08:46:13 dist-test-slave-39l8 krb5kdc[19366](info): commencing operation
krb5kdc: starting...
W20260808 08:46:15.165820 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.356s user 0.002s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:15 dist-test-slave-39l8 krb5kdc[19366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:15.542660 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45645
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:15.928004 19385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:15.928362 19385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:15.928537 19385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:15.936136 19385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:15.936273 19385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:15.936369 19385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:15.936491 19385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:15.936555 19385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:15.947235 19385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45645
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:15.948752 19385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:15.950322 19385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:15.963492 19392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:15.963454 19393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:15.963531 19396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:15.964733 19385 server_base.cc:1034] running on GCE node
I20260808 08:46:15.965629 19385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:15.967285 19385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:15.968549 19385 hybrid_clock.cc:648] HybridClock initialized: now 1786178775968502 us; error 46 us; skew 500 ppm
I20260808 08:46:15.968981 19385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:15 dist-test-slave-39l8 krb5kdc[19366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178775, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:15.972694 19385 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:15.974548 19385 webserver.cc:460] Webserver started at http://127.0.0.1:37429/ using document root <none> and password file <none>
I20260808 08:46:15.975464 19385 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:15.975638 19385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:15.975992 19385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:15.979507 19385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "7e29cc3f72c04e868e9c804634c4a4cf"
format_stamp: "Formatted at 2026-08-08 08:46:15 on dist-test-slave-39l8"
server_key: "83e48cad43560539c25dfa55c3183eb7"
server_key_iv: "d123a4eefccce815b64a2c32cd46419e"
server_key_version: "encryptionkey@0"
I20260808 08:46:15.980406 19385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "7e29cc3f72c04e868e9c804634c4a4cf"
format_stamp: "Formatted at 2026-08-08 08:46:15 on dist-test-slave-39l8"
server_key: "83e48cad43560539c25dfa55c3183eb7"
server_key_iv: "d123a4eefccce815b64a2c32cd46419e"
server_key_version: "encryptionkey@0"
I20260808 08:46:15.986577 19385 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:46:15.990554 19405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:15.992415 19385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:46:15.992646 19385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "7e29cc3f72c04e868e9c804634c4a4cf"
format_stamp: "Formatted at 2026-08-08 08:46:15 on dist-test-slave-39l8"
server_key: "83e48cad43560539c25dfa55c3183eb7"
server_key_iv: "d123a4eefccce815b64a2c32cd46419e"
server_key_version: "encryptionkey@0"
I20260808 08:46:15.992883 19385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:16.023398 19385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:16.028296 19385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:16.028627 19385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:16.049983 19385 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45645
I20260808 08:46:16.050005 19473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45645 every 8 connection(s)
I20260808 08:46:16.051647 19385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:16.056383 19475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:16.060865 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 19385
I20260808 08:46:16.061108 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:16.061780 20427 external_mini_cluster.cc:1428] Setting key a9cea687697c2f13e877d07fe932149d
I20260808 08:46:16.070981 19475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf: Bootstrap starting.
I20260808 08:46:16.074607 19475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:16.076005 19475 log.cc:824] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:16.077976 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:16.064115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:39573 (local address 127.0.0.1:45645)
0808 08:46:16.065056 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:16.065070 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:16.065125 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:46:16.067145 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:16.067181 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:16.067711 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:16.068226 (+ 515us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:16.068880 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:16.070268 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:16.071880 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:16.072647 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:16.072880 (+ 233us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:16.074477 (+ 1597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:16.074485 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:16.074510 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:16.075352 (+ 842us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:16.075450 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:16.075495 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:16.075718 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:16.076091 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 08:46:16.076332 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":417,"threads_started":1}
I20260808 08:46:16.079891 19475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf: No bootstrap required, opened a new log
I20260808 08:46:16.083029 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:16.088599 19475 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45645 } }
I20260808 08:46:16.089313 19475 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:16.089432 19475 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e29cc3f72c04e868e9c804634c4a4cf, State: Initialized, Role: FOLLOWER
I20260808 08:46:16.090267 19475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45645 } }
I20260808 08:46:16.090621 19475 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:16.090798 19475 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:16.090988 19475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:16.093968 19475 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45645 } }
I20260808 08:46:16.094583 19475 leader_election.cc:302] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e29cc3f72c04e868e9c804634c4a4cf; no voters:
I20260808 08:46:16.095391 19475 leader_election.cc:288] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:16.095575 19489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:16.097108 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:16.087989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:48631 (local address 127.0.0.1:45645)
0808 08:46:16.088230 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:16.088237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:16.088705 (+ 468us) server_negotiation.cc:407] Connection header received
0808 08:46:16.088880 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:16.088886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:16.088976 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:16.089120 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:16.089917 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:16.091111 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:16.092769 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:16.093479 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:16.093654 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:16.095203 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:16.095217 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:16.095224 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:16.095262 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:16.095322 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:16.095350 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:16.095502 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:16.096410 (+ 908us) server_negotiation.cc:299] Negotiation successful
0808 08:46:16.096522 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:46:16.097026 19489 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [term 1 LEADER]: Becoming Leader. State: Replica: 7e29cc3f72c04e868e9c804634c4a4cf, State: Running, Role: LEADER
I20260808 08:46:16.097980 19489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45645 } }
I20260808 08:46:16.098220 19475 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:16.101451 19492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e29cc3f72c04e868e9c804634c4a4cf. Latest consensus state: current_term: 1 leader_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45645 } } }
I20260808 08:46:16.101541 19490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e29cc3f72c04e868e9c804634c4a4cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45645 } } }
I20260808 08:46:16.101984 19492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:16.101984 19490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:16.105639 19496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:16.112233 19496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:16.123706 19496 catalog_manager.cc:1347] Generated new cluster ID: bb80be5147ff4174a28a45bf89d61c01
I20260808 08:46:16.123857 19496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:16.133152 19496 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:16.134662 19496 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:16.141112 19496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e29cc3f72c04e868e9c804634c4a4cf: Generated new TSK 0
I20260808 08:46:16.142305 19496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:16.156087 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19385
W20260808 08:46:16.157559 19465 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.38:39573
W20260808 08:46:16.158699 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19385: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:16.158910 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 19385
W20260808 08:46:16.189438 19363 connection.cc:535] client connection to 127.0.0.1:45645 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45645): Connection reset by peer (error 104)
2026-08-08T08:46:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2399 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:16 dist-test-slave-39l8 krb5kdc[19518](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:16 dist-test-slave-39l8 krb5kdc[19518](info): set up 2 sockets
Aug 08 08:46:16 dist-test-slave-39l8 krb5kdc[19518](info): commencing operation
krb5kdc: starting...
W20260808 08:46:17.600556 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.390s user 0.006s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:17 dist-test-slave-39l8 krb5kdc[19518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178777, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:46:17.977916 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41323
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:18.367547 19537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:18.367897 19537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:18.367996 19537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:18.375748 19537 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:18.375895 19537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:18.375952 19537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:18.376008 19537 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:18.376055 19537 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:18.388091 19537 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41323
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:18.389592 19537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:18.391155 19537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:18.406271 19544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:18.406352 19545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:18.406371 19548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:18.413247 19537 server_base.cc:1034] running on GCE node
I20260808 08:46:18.414414 19537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:18.416306 19537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:18.417618 19537 hybrid_clock.cc:648] HybridClock initialized: now 1786178778417547 us; error 70 us; skew 500 ppm
I20260808 08:46:18.418071 19537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:18 dist-test-slave-39l8 krb5kdc[19518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178778, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:18.427680 19537 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:46:18.429716 19537 webserver.cc:460] Webserver started at http://127.0.0.1:44091/ using document root <none> and password file <none>
I20260808 08:46:18.430653 19537 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:18.430902 19537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:18.431308 19537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:18.435137 19537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "d5953f86a92b4fe99e9a5b8078f1946d"
format_stamp: "Formatted at 2026-08-08 08:46:18 on dist-test-slave-39l8"
server_key: "f0d78b415882369f4a865d01b89e5b80"
server_key_iv: "de0feeb8e34eab1bb399d5dc95a3d2f1"
server_key_version: "encryptionkey@0"
I20260808 08:46:18.436152 19537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "d5953f86a92b4fe99e9a5b8078f1946d"
format_stamp: "Formatted at 2026-08-08 08:46:18 on dist-test-slave-39l8"
server_key: "f0d78b415882369f4a865d01b89e5b80"
server_key_iv: "de0feeb8e34eab1bb399d5dc95a3d2f1"
server_key_version: "encryptionkey@0"
I20260808 08:46:18.442865 19537 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 08:46:18.447772 19559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:18.449522 19537 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:46:18.449793 19537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "d5953f86a92b4fe99e9a5b8078f1946d"
format_stamp: "Formatted at 2026-08-08 08:46:18 on dist-test-slave-39l8"
server_key: "f0d78b415882369f4a865d01b89e5b80"
server_key_iv: "de0feeb8e34eab1bb399d5dc95a3d2f1"
server_key_version: "encryptionkey@0"
I20260808 08:46:18.450030 19537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:18.457391 19537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:18.462556 19537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:18.463088 19537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:18.485321 19537 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41323
I20260808 08:46:18.485369 19632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41323 every 8 connection(s)
I20260808 08:46:18.487092 19537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:18.487654 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 19537
I20260808 08:46:18.487874 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:18.488659 20427 external_mini_cluster.cc:1428] Setting key dafda16b72a81cb560ac772b92b471aa
I20260808 08:46:18.492738 19634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:18.498572 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:18.491247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:35351 (local address 127.0.0.1:41323)
0808 08:46:18.492299 (+ 1052us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:18.492313 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:18.492361 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:46:18.494316 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:18.494344 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:18.494846 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:18.495253 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:18.496634 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:18.496646 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:18.496662 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:18.496691 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:18.496784 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:18.496809 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:18.497013 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:18.497189 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 08:46:18.497474 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":441,"threads_started":1}
I20260808 08:46:18.503123 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:18.507028 19634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d: Bootstrap starting.
I20260808 08:46:18.511448 19634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:18.512318 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:18.508487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.38:52155 (local address 127.0.0.1:41323)
0808 08:46:18.508760 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:18.508777 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:18.509492 (+ 715us) server_negotiation.cc:407] Connection header received
0808 08:46:18.509664 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:18.509670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:18.509760 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:18.509889 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:18.511358 (+ 1469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:18.511364 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:18.511369 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:18.511394 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:18.511462 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:18.511488 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:18.511639 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:18.511854 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 08:46:18.511949 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:46:18.513041 19634 log.cc:824] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:18.516561 19634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d: No bootstrap required, opened a new log
I20260808 08:46:18.525117 19634 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 08:46:18.525628 19634 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:18.525761 19634 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5953f86a92b4fe99e9a5b8078f1946d, State: Initialized, Role: FOLLOWER
I20260808 08:46:18.526432 19634 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 08:46:18.526777 19634 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:18.526957 19634 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:18.527168 19634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:18.529700 19634 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 08:46:18.530361 19634 leader_election.cc:302] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5953f86a92b4fe99e9a5b8078f1946d; no voters:
I20260808 08:46:18.531260 19634 leader_election.cc:288] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:18.531402 19649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:18.532302 19649 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [term 1 LEADER]: Becoming Leader. State: Replica: d5953f86a92b4fe99e9a5b8078f1946d, State: Running, Role: LEADER
I20260808 08:46:18.533046 19649 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } }
I20260808 08:46:18.534158 19634 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:18.536615 19650 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } } }
I20260808 08:46:18.537109 19650 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:18.537601 19652 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5953f86a92b4fe99e9a5b8078f1946d. Latest consensus state: current_term: 1 leader_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5953f86a92b4fe99e9a5b8078f1946d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41323 } } }
I20260808 08:46:18.537827 19652 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:18.542384 19662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:18.548287 19662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:18.557968 19662 catalog_manager.cc:1347] Generated new cluster ID: 81e2344e9188463b94ec3a517d775b25
I20260808 08:46:18.558143 19662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:18.577283 19662 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:18.577937 19662 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:18.595606 19662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5953f86a92b4fe99e9a5b8078f1946d: Generated new TSK 0
I20260808 08:46:18.596803 19662 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:18.610618 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19537
W20260808 08:46:18.612607 19628 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.38:35351
W20260808 08:46:18.613498 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19537: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:18.613690 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 19537
2026-08-08T08:46:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:18 dist-test-slave-39l8 krb5kdc[19682](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:18 dist-test-slave-39l8 krb5kdc[19682](info): set up 2 sockets
Aug 08 08:46:18 dist-test-slave-39l8 krb5kdc[19682](info): commencing operation
krb5kdc: starting...
W20260808 08:46:19.972415 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.001s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:20 dist-test-slave-39l8 krb5kdc[19682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:20.359159 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44779
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:44373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:44779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:20.739440 19703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:20.739786 19703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:20.739977 19703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:20.747834 19703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:20.747980 19703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:20.748075 19703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:20.748204 19703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:20.748287 19703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:20.759442 19703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:44779
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:44779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:20.760937 19703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:20.762360 19703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:20.775449 19710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:20.775522 19714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:20.775547 19716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:20.776618 19703 server_base.cc:1034] running on GCE node
I20260808 08:46:20.777585 19703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:20.779341 19703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:20.780583 19703 hybrid_clock.cc:648] HybridClock initialized: now 1786178780780525 us; error 46 us; skew 500 ppm
I20260808 08:46:20.780994 19703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:20 dist-test-slave-39l8 krb5kdc[19682](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178780, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:20.784674 19703 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:20.786422 19703 webserver.cc:460] Webserver started at http://127.19.242.254:43383/ using document root <none> and password file <none>
I20260808 08:46:20.787318 19703 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:20.787470 19703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:20.787863 19703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:20.791666 19703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "c2a77891b3e54e978b2b7a98a13bdac7"
format_stamp: "Formatted at 2026-08-08 08:46:20 on dist-test-slave-39l8"
server_key: "681a66876c52b87ec6542bfd1b2c4213"
server_key_iv: "02e82e0d564af55021c5ffe6540cd86a"
server_key_version: "encryptionkey@0"
I20260808 08:46:20.792697 19703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "c2a77891b3e54e978b2b7a98a13bdac7"
format_stamp: "Formatted at 2026-08-08 08:46:20 on dist-test-slave-39l8"
server_key: "681a66876c52b87ec6542bfd1b2c4213"
server_key_iv: "02e82e0d564af55021c5ffe6540cd86a"
server_key_version: "encryptionkey@0"
I20260808 08:46:20.799641 19703 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:46:20.803943 19727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:20.805629 19703 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260808 08:46:20.805876 19703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "c2a77891b3e54e978b2b7a98a13bdac7"
format_stamp: "Formatted at 2026-08-08 08:46:20 on dist-test-slave-39l8"
server_key: "681a66876c52b87ec6542bfd1b2c4213"
server_key_iv: "02e82e0d564af55021c5ffe6540cd86a"
server_key_version: "encryptionkey@0"
I20260808 08:46:20.806125 19703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:20.823905 19703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:20.829227 19703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:20.829620 19703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:20.851686 19703 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:44779
I20260808 08:46:20.851687 19805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:44779 every 8 connection(s)
I20260808 08:46:20.853312 19703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:20.857697 19807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:20.859491 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 19703
I20260808 08:46:20.859714 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:20.860370 20427 external_mini_cluster.cc:1428] Setting key 42304cad46789254ec7e01d731066839
I20260808 08:46:20.872706 19807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7: Bootstrap starting.
Aug 08 08:46:20 dist-test-slave-39l8 krb5kdc[19682](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:20.876367 19807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:20.877568 19807 log.cc:824] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:20.881269 19807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7: No bootstrap required, opened a new log
I20260808 08:46:20.886274 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:20.862675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51185 (local address 127.19.242.254:44779)
0808 08:46:20.863696 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:20.863713 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:20.863763 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:46:20.865514 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:20.865543 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:20.866046 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:20.866556 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:20.868254 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:20.869666 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:20.871252 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:20.872045 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:20.872275 (+ 230us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:20.877164 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:20.877174 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:20.877191 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:20.877238 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:20.880959 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:20.882112 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:20.882124 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:20.882132 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:20.882338 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:20.882964 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:20.882971 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:20.882974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:20.883647 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:20.884084 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:20.884651 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 08:46:20.885074 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":433,"threads_started":1}
I20260808 08:46:20.890257 19807 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44779 } }
I20260808 08:46:20.890808 19807 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:20.890949 19807 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2a77891b3e54e978b2b7a98a13bdac7, State: Initialized, Role: FOLLOWER
I20260808 08:46:20.891247 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:20.891650 19807 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44779 } }
I20260808 08:46:20.891933 19807 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:20.892113 19807 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:20.892306 19807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:20.895201 19807 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44779 } }
I20260808 08:46:20.895889 19807 leader_election.cc:302] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2a77891b3e54e978b2b7a98a13bdac7; no voters:
I20260808 08:46:20.896735 19807 leader_election.cc:288] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:20.896872 19826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:20.898792 19826 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [term 1 LEADER]: Becoming Leader. State: Replica: c2a77891b3e54e978b2b7a98a13bdac7, State: Running, Role: LEADER
I20260808 08:46:20.899641 19826 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44779 } }
I20260808 08:46:20.900362 19807 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:20.903352 19828 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2a77891b3e54e978b2b7a98a13bdac7. Latest consensus state: current_term: 1 leader_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44779 } } }
I20260808 08:46:20.903442 19829 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2a77891b3e54e978b2b7a98a13bdac7" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 44779 } } }
I20260808 08:46:20.903990 19828 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:20.904017 19829 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:20.904992 19835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:20.922720 19818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:20.896599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44847 (local address 127.19.242.254:44779)
0808 08:46:20.896815 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:20.896821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:20.897661 (+ 840us) server_negotiation.cc:407] Connection header received
0808 08:46:20.897901 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:20.897908 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:20.898023 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:20.899352 (+ 1329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:20.900330 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:20.901234 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:20.904492 (+ 3258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:20.905276 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:20.905473 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:20.910154 (+ 4681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:20.910165 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:20.910171 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:20.910244 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:20.916072 (+ 5828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:20.917859 (+ 1787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:20.917869 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:20.917875 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:20.918116 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:20.918992 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:20.919001 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:20.919007 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:20.919658 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:20.920078 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:20.921759 (+ 1681us) server_negotiation.cc:299] Negotiation successful
0808 08:46:20.922054 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:46:20.924062 19835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:20.941859 19835 catalog_manager.cc:1347] Generated new cluster ID: f5c903c8eaae4b3a9998cda638df2876
I20260808 08:46:20.942011 19835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:20.968319 19835 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:20.970072 19835 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:20.982131 19835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2a77891b3e54e978b2b7a98a13bdac7: Generated new TSK 0
I20260808 08:46:20.983493 19835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:20.992738 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19703
I20260808 08:46:20.994516 19801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:21.091480 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 19703
W20260808 08:46:21.119887 19680 connection.cc:535] client connection to 127.19.242.254:44779 recv error: Network error: failed to read from TLS socket (remote: 127.19.242.254:44779): Connection reset by peer (error 104)
2026-08-08T08:46:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2480 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:21 dist-test-slave-39l8 krb5kdc[19857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:21 dist-test-slave-39l8 krb5kdc[19857](info): set up 2 sockets
Aug 08 08:46:21 dist-test-slave-39l8 krb5kdc[19857](info): commencing operation
krb5kdc: starting...
W20260808 08:46:22.457435 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:22 dist-test-slave-39l8 krb5kdc[19857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:22.833841 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:32887
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:44313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:32887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:23.234542 19878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:23.234980 19878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:23.235092 19878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:23.242842 19878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:23.242987 19878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:23.243040 19878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:23.243108 19878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:23.243176 19878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:23.253890 19878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:32887
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:32887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:23.255525 19878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:23.257042 19878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:23.270974 19888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:23.270993 19887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:23.271090 19890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:23.271976 19878 server_base.cc:1034] running on GCE node
I20260808 08:46:23.272975 19878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:23.274688 19878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:23.276017 19878 hybrid_clock.cc:648] HybridClock initialized: now 1786178783275949 us; error 46 us; skew 500 ppm
I20260808 08:46:23.276494 19878 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:23 dist-test-slave-39l8 krb5kdc[19857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178783, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:23.280411 19878 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:23.282335 19878 webserver.cc:460] Webserver started at http://127.19.242.254:38189/ using document root <none> and password file <none>
I20260808 08:46:23.283270 19878 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:23.283448 19878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:23.283815 19878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:23.287499 19878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "9578db63e27846b9bfea8b13ef725d84"
format_stamp: "Formatted at 2026-08-08 08:46:23 on dist-test-slave-39l8"
server_key: "3f4d3ee1febb6d746009b3e5507f49ad"
server_key_iv: "7da489a22918d4b1bba1a255577b8f74"
server_key_version: "encryptionkey@0"
I20260808 08:46:23.288479 19878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "9578db63e27846b9bfea8b13ef725d84"
format_stamp: "Formatted at 2026-08-08 08:46:23 on dist-test-slave-39l8"
server_key: "3f4d3ee1febb6d746009b3e5507f49ad"
server_key_iv: "7da489a22918d4b1bba1a255577b8f74"
server_key_version: "encryptionkey@0"
I20260808 08:46:23.294885 19878 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:46:23.299813 19899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:23.301575 19878 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:46:23.301837 19878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "9578db63e27846b9bfea8b13ef725d84"
format_stamp: "Formatted at 2026-08-08 08:46:23 on dist-test-slave-39l8"
server_key: "3f4d3ee1febb6d746009b3e5507f49ad"
server_key_iv: "7da489a22918d4b1bba1a255577b8f74"
server_key_version: "encryptionkey@0"
I20260808 08:46:23.302086 19878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:23.325994 19878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:23.331132 19878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:23.331466 19878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:23.353276 19878 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:32887
I20260808 08:46:23.353387 19983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:32887 every 8 connection(s)
I20260808 08:46:23.354987 19878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:23.356829 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 19878
I20260808 08:46:23.357057 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:23.357673 20427 external_mini_cluster.cc:1428] Setting key 156714cbd491475e4a2399cf7a556387
I20260808 08:46:23.360764 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:23.374249 19987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:23.359876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47823 (local address 127.19.242.254:32887)
0808 08:46:23.360924 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:23.360944 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:23.361004 (+ 60us) server_negotiation.cc:407] Connection header received
0808 08:46:23.363197 (+ 2193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:23.363225 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:23.363707 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:23.364108 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:23.364893 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:23.366452 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:23.368700 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:23.369506 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:23.369671 (+ 165us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:23.371347 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:23.371361 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:23.371379 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:23.372157 (+ 778us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:23.372240 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:23.372280 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:23.372444 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:23.372928 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 08:46:23.373161 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":470,"threads_started":1}
I20260808 08:46:23.375834 19984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84: Bootstrap starting.
I20260808 08:46:23.379298 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:23.379873 19984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:23.381067 19984 log.cc:824] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:23.386000 19984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84: No bootstrap required, opened a new log
I20260808 08:46:23.394800 19987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:23.385771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54791 (local address 127.19.242.254:32887)
0808 08:46:23.386073 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:23.386083 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:23.387094 (+ 1011us) server_negotiation.cc:407] Connection header received
0808 08:46:23.387309 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:23.387316 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:23.387407 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:23.387575 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:23.388158 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:23.389586 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:23.391410 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:23.392306 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:23.392484 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:23.393852 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:23.393859 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:23.393864 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:23.393890 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:23.393976 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:23.394000 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:23.394142 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:23.394333 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 08:46:23.394406 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260808 08:46:23.397867 19984 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9578db63e27846b9bfea8b13ef725d84" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32887 } }
I20260808 08:46:23.398331 19984 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:23.398424 19984 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9578db63e27846b9bfea8b13ef725d84, State: Initialized, Role: FOLLOWER
I20260808 08:46:23.399113 19984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9578db63e27846b9bfea8b13ef725d84" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32887 } }
I20260808 08:46:23.399355 19984 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:23.399479 19984 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:23.399642 19984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:23.402292 19984 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9578db63e27846b9bfea8b13ef725d84" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32887 } }
I20260808 08:46:23.403049 19984 leader_election.cc:302] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9578db63e27846b9bfea8b13ef725d84; no voters:
I20260808 08:46:23.403932 19984 leader_election.cc:288] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:23.404022 19998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:23.404868 19998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [term 1 LEADER]: Becoming Leader. State: Replica: 9578db63e27846b9bfea8b13ef725d84, State: Running, Role: LEADER
I20260808 08:46:23.405539 19998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9578db63e27846b9bfea8b13ef725d84" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32887 } }
I20260808 08:46:23.406544 19984 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:23.409520 20001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9578db63e27846b9bfea8b13ef725d84. Latest consensus state: current_term: 1 leader_uuid: "9578db63e27846b9bfea8b13ef725d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9578db63e27846b9bfea8b13ef725d84" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32887 } } }
I20260808 08:46:23.409014 20000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9578db63e27846b9bfea8b13ef725d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9578db63e27846b9bfea8b13ef725d84" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 32887 } } }
I20260808 08:46:23.410111 20001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:23.410171 20000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:23.416615 20013 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:23.424635 20013 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:23.435307 20013 catalog_manager.cc:1347] Generated new cluster ID: 2a83c33d7ad54a349e9320335473b430
I20260808 08:46:23.435461 20013 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:23.448153 20013 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:23.449766 20013 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:23.470490 20013 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9578db63e27846b9bfea8b13ef725d84: Generated new TSK 0
I20260808 08:46:23.471501 20013 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:23.497110 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19878
W20260808 08:46:23.498543 19976 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47823
W20260808 08:46:23.499516 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 19878: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:23.499728 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 19878
W20260808 08:46:23.529202 19854 connection.cc:535] client connection to 127.19.242.254:32887 recv error: Network error: failed to read from TLS socket (remote: 127.19.242.254:32887): Connection reset by peer (error 104)
2026-08-08T08:46:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2408 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:23 dist-test-slave-39l8 krb5kdc[20032](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:23 dist-test-slave-39l8 krb5kdc[20032](info): set up 2 sockets
Aug 08 08:46:23 dist-test-slave-39l8 krb5kdc[20032](info): commencing operation
krb5kdc: starting...
W20260808 08:46:24.875569 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.001s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:25 dist-test-slave-39l8 krb5kdc[20032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:25.250113 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46645
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:32893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:46645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:25.628172 20049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:25.628504 20049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:25.628684 20049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:25.636268 20049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:25.636409 20049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:25.636546 20049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:25.636652 20049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:25.636736 20049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:25.647284 20049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:32893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:46645
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:46645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:25.648779 20049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:25.650511 20049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:25.663498 20057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:25.663551 20058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:25.663575 20062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:25.664939 20049 server_base.cc:1034] running on GCE node
I20260808 08:46:25.665904 20049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:25.667585 20049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:25.668856 20049 hybrid_clock.cc:648] HybridClock initialized: now 1786178785668809 us; error 61 us; skew 500 ppm
I20260808 08:46:25.669294 20049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:25 dist-test-slave-39l8 krb5kdc[20032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178785, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:25.672821 20049 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:25.674528 20049 webserver.cc:460] Webserver started at http://127.19.242.254:40407/ using document root <none> and password file <none>
I20260808 08:46:25.675328 20049 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:25.675441 20049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:25.675724 20049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:25.679180 20049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "472331d5191244fb948a61b2ec37366d"
format_stamp: "Formatted at 2026-08-08 08:46:25 on dist-test-slave-39l8"
server_key: "62e9f4816d55de5c448783d479a34158"
server_key_iv: "2343498e7ffce6c197ff3cb14d4c4ce7"
server_key_version: "encryptionkey@0"
I20260808 08:46:25.679976 20049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "472331d5191244fb948a61b2ec37366d"
format_stamp: "Formatted at 2026-08-08 08:46:25 on dist-test-slave-39l8"
server_key: "62e9f4816d55de5c448783d479a34158"
server_key_iv: "2343498e7ffce6c197ff3cb14d4c4ce7"
server_key_version: "encryptionkey@0"
I20260808 08:46:25.685892 20049 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:46:25.690068 20071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:25.691815 20049 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:46:25.692049 20049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "472331d5191244fb948a61b2ec37366d"
format_stamp: "Formatted at 2026-08-08 08:46:25 on dist-test-slave-39l8"
server_key: "62e9f4816d55de5c448783d479a34158"
server_key_iv: "2343498e7ffce6c197ff3cb14d4c4ce7"
server_key_version: "encryptionkey@0"
I20260808 08:46:25.692325 20049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:25.699011 20049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:25.703884 20049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:25.704293 20049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:25.725163 20049 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:46645
I20260808 08:46:25.725200 20161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:46645 every 8 connection(s)
I20260808 08:46:25.726823 20049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:25.729809 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20049
I20260808 08:46:25.730036 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:25.730509 20427 external_mini_cluster.cc:1428] Setting key 48c3deab477ff4766eada9fe53896b72
I20260808 08:46:25.731108 20162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:25.740149 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:25.732620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33967 (local address 127.19.242.254:46645)
0808 08:46:25.733514 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:25.733527 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:25.733572 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:46:25.736156 (+ 2584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:25.736185 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:25.736589 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:25.736986 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:25.738328 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:25.738335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:25.738350 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:25.738367 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:25.738438 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:25.738458 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:25.738656 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:25.738881 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 08:46:25.739124 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":410,"threads_started":1}
I20260808 08:46:25.744431 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:25.745711 20162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d: Bootstrap starting.
I20260808 08:46:25.749315 20162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:25.750835 20162 log.cc:824] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:25.752094 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:25.749209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36707 (local address 127.19.242.254:46645)
0808 08:46:25.749437 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:25.749446 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:25.749886 (+ 440us) server_negotiation.cc:407] Connection header received
0808 08:46:25.750033 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:25.750039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:25.750105 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:25.750225 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:25.751341 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:25.751345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:25.751348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:25.751365 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:25.751407 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:25.751422 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:25.751565 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:25.751740 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 08:46:25.751802 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:46:25.754621 20162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d: No bootstrap required, opened a new log
I20260808 08:46:25.762959 20162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472331d5191244fb948a61b2ec37366d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46645 } }
I20260808 08:46:25.763442 20162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:25.763561 20162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 472331d5191244fb948a61b2ec37366d, State: Initialized, Role: FOLLOWER
I20260808 08:46:25.764307 20162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472331d5191244fb948a61b2ec37366d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46645 } }
I20260808 08:46:25.764572 20162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:25.764743 20162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:25.764936 20162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:25.767652 20162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472331d5191244fb948a61b2ec37366d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46645 } }
I20260808 08:46:25.768316 20162 leader_election.cc:302] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 472331d5191244fb948a61b2ec37366d; no voters:
I20260808 08:46:25.769084 20162 leader_election.cc:288] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:25.769285 20182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:25.770012 20182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [term 1 LEADER]: Becoming Leader. State: Replica: 472331d5191244fb948a61b2ec37366d, State: Running, Role: LEADER
I20260808 08:46:25.770632 20182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472331d5191244fb948a61b2ec37366d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46645 } }
I20260808 08:46:25.771575 20162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:25.774657 20183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "472331d5191244fb948a61b2ec37366d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472331d5191244fb948a61b2ec37366d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46645 } } }
I20260808 08:46:25.775182 20183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:25.774852 20185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 472331d5191244fb948a61b2ec37366d. Latest consensus state: current_term: 1 leader_uuid: "472331d5191244fb948a61b2ec37366d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472331d5191244fb948a61b2ec37366d" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 46645 } } }
I20260808 08:46:25.775336 20185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:25.777802 20188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:25.785184 20188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:25.795432 20188 catalog_manager.cc:1347] Generated new cluster ID: 32319bfebe1f484c8794112c5b693822
I20260808 08:46:25.795607 20188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:25.814944 20188 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:25.815481 20188 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:25.823731 20188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 472331d5191244fb948a61b2ec37366d: Generated new TSK 0
I20260808 08:46:25.824681 20188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:25.833889 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20049
W20260808 08:46:25.835269 20152 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33967
W20260808 08:46:25.836084 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20049: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:25.836287 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20049
2026-08-08T08:46:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2333 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:25 dist-test-slave-39l8 krb5kdc[20206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:25 dist-test-slave-39l8 krb5kdc[20206](info): set up 2 sockets
Aug 08 08:46:25 dist-test-slave-39l8 krb5kdc[20206](info): commencing operation
krb5kdc: starting...
W20260808 08:46:27.193920 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:27 dist-test-slave-39l8 krb5kdc[20206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:27.568240 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43353
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:34777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:43353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:27.938860 20224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:27.939270 20224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:27.939438 20224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:27.947228 20224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:27.947417 20224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:27.947515 20224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:27.947649 20224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:27.947728 20224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:27.958216 20224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:34777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:43353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:43353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:27.959743 20224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:27.961174 20224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:27.973941 20234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:27.974000 20230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:27.974134 20232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:27.975534 20224 server_base.cc:1034] running on GCE node
I20260808 08:46:27.976511 20224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:27.978108 20224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:27.979382 20224 hybrid_clock.cc:648] HybridClock initialized: now 1786178787979381 us; error 84 us; skew 500 ppm
I20260808 08:46:27.979795 20224 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:27 dist-test-slave-39l8 krb5kdc[20206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178787, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:27.983529 20224 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:27.985232 20224 webserver.cc:460] Webserver started at http://127.19.242.254:35765/ using document root <none> and password file <none>
I20260808 08:46:27.986014 20224 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:27.986207 20224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:27.986546 20224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:27.989902 20224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "abe7ecdc9bd94b719552cd5647bc1eb4"
format_stamp: "Formatted at 2026-08-08 08:46:27 on dist-test-slave-39l8"
server_key: "12f11a2a6cc5e8c9a944865df997250f"
server_key_iv: "3d21e916593afd57b3fe524e28c703e5"
server_key_version: "encryptionkey@0"
I20260808 08:46:27.990904 20224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "abe7ecdc9bd94b719552cd5647bc1eb4"
format_stamp: "Formatted at 2026-08-08 08:46:27 on dist-test-slave-39l8"
server_key: "12f11a2a6cc5e8c9a944865df997250f"
server_key_iv: "3d21e916593afd57b3fe524e28c703e5"
server_key_version: "encryptionkey@0"
I20260808 08:46:27.996870 20224 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:46:28.001008 20247 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:28.002696 20224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:46:28.002997 20224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "abe7ecdc9bd94b719552cd5647bc1eb4"
format_stamp: "Formatted at 2026-08-08 08:46:27 on dist-test-slave-39l8"
server_key: "12f11a2a6cc5e8c9a944865df997250f"
server_key_iv: "3d21e916593afd57b3fe524e28c703e5"
server_key_version: "encryptionkey@0"
I20260808 08:46:28.003240 20224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:28.034190 20224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:28.040349 20224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:28.040717 20224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:28.062888 20224 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:43353
I20260808 08:46:28.062930 20315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:43353 every 8 connection(s)
I20260808 08:46:28.064491 20224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:28.067026 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20224
I20260808 08:46:28.067255 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:28.067746 20427 external_mini_cluster.cc:1428] Setting key 38db300046efc2e3836eac77d3bd0f25
I20260808 08:46:28.069401 20316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:28.084622 20316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4: Bootstrap starting.
Aug 08 08:46:28 dist-test-slave-39l8 krb5kdc[20206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:28.088670 20316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:28.089897 20316 log.cc:824] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:28.093334 20316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4: No bootstrap required, opened a new log
I20260808 08:46:28.095590 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:28.069939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60051 (local address 127.19.242.254:43353)
0808 08:46:28.070904 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:28.070920 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:28.070975 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:46:28.073112 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:28.073153 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:28.073788 (+ 635us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:28.074317 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:28.076158 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:28.078352 (+ 2194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:28.079908 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:28.081093 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:28.081335 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:28.086400 (+ 5065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:28.086411 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:28.086427 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:28.086479 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:28.090393 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:28.091416 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:28.091426 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:28.091435 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:28.091659 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:28.092175 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:28.092180 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:28.092182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:28.092803 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:28.093219 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:28.093785 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 08:46:28.094326 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":394,"threads_started":1}
I20260808 08:46:28.100564 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:28.102955 20316 raft_consensus.cc:348] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43353 } }
I20260808 08:46:28.103432 20316 raft_consensus.cc:374] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:28.103570 20316 raft_consensus.cc:729] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe7ecdc9bd94b719552cd5647bc1eb4, State: Initialized, Role: FOLLOWER
I20260808 08:46:28.104383 20316 consensus_queue.cc:260] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43353 } }
I20260808 08:46:28.104668 20316 raft_consensus.cc:388] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:28.104843 20316 raft_consensus.cc:482] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:28.105029 20316 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:28.108407 20316 raft_consensus.cc:504] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43353 } }
I20260808 08:46:28.109128 20316 leader_election.cc:302] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abe7ecdc9bd94b719552cd5647bc1eb4; no voters:
I20260808 08:46:28.109918 20316 leader_election.cc:288] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:28.110046 20334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:28.112614 20334 raft_consensus.cc:686] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [term 1 LEADER]: Becoming Leader. State: Replica: abe7ecdc9bd94b719552cd5647bc1eb4, State: Running, Role: LEADER
I20260808 08:46:28.112948 20316 sys_catalog.cc:564] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:28.113372 20334 consensus_queue.cc:237] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43353 } }
I20260808 08:46:28.118991 20336 sys_catalog.cc:455] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abe7ecdc9bd94b719552cd5647bc1eb4. Latest consensus state: current_term: 1 leader_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43353 } } }
I20260808 08:46:28.119571 20336 sys_catalog.cc:458] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:28.118964 20335 sys_catalog.cc:455] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe7ecdc9bd94b719552cd5647bc1eb4" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 43353 } } }
I20260808 08:46:28.120116 20335 sys_catalog.cc:458] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:28.120863 20347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:28.127245 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:28.105931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37841 (local address 127.19.242.254:43353)
0808 08:46:28.106139 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:28.106145 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:28.106780 (+ 635us) server_negotiation.cc:407] Connection header received
0808 08:46:28.107064 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:28.107070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:28.107204 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:28.107332 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:28.109381 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:28.110512 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:28.112281 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:28.113140 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:28.113313 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:28.116575 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:28.116595 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:28.116606 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:28.116671 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:28.121813 (+ 5142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:28.123168 (+ 1355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:28.123174 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:28.123179 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:28.123457 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:28.124126 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:28.124136 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:28.124139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:28.124650 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:28.124968 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:28.126400 (+ 1432us) server_negotiation.cc:299] Negotiation successful
0808 08:46:28.126756 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:46:28.130967 20347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:28.142735 20347 catalog_manager.cc:1347] Generated new cluster ID: 185b805def6c4b618b9dea3c44e8d54d
I20260808 08:46:28.142912 20347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:28.161953 20347 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:28.164057 20347 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:28.172230 20347 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abe7ecdc9bd94b719552cd5647bc1eb4: Generated new TSK 0
I20260808 08:46:28.173350 20347 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:28.179957 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20224
I20260808 08:46:28.181983 20309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:28.274786 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20224
2026-08-08T08:46:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2437 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:28 dist-test-slave-39l8 krb5kdc[20366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:28 dist-test-slave-39l8 krb5kdc[20366](info): set up 2 sockets
Aug 08 08:46:28 dist-test-slave-39l8 krb5kdc[20366](info): commencing operation
krb5kdc: starting...
W20260808 08:46:29.728191 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.409s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:29 dist-test-slave-39l8 krb5kdc[20366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:30.100654 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35181
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:44297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:35181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:30.468401 20384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:30.468739 20384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:30.468930 20384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:30.476557 20384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:30.476692 20384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:30.476787 20384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:30.476904 20384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:30.476985 20384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:30.487849 20384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:44297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:35181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:35181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:30.489305 20384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:30.490685 20384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:30.503788 20392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:30.503844 20393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:30.504483 20396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:30.504715 20384 server_base.cc:1034] running on GCE node
I20260808 08:46:30.505633 20384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:30.507359 20384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:30.508616 20384 hybrid_clock.cc:648] HybridClock initialized: now 1786178790508565 us; error 49 us; skew 500 ppm
I20260808 08:46:30.509009 20384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:30 dist-test-slave-39l8 krb5kdc[20366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178790, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:30.518661 20384 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:30.520604 20384 webserver.cc:460] Webserver started at http://127.19.242.254:45197/ using document root <none> and password file <none>
I20260808 08:46:30.521405 20384 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:30.521570 20384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:30.521900 20384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:30.525309 20384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "d7aca7bac42e4f738c93d61bf4347d30"
format_stamp: "Formatted at 2026-08-08 08:46:30 on dist-test-slave-39l8"
server_key: "c63d7f92b7da2c6e711f694c2ef6e35f"
server_key_iv: "92becc9a0de68965ea5259586e64aaac"
server_key_version: "encryptionkey@0"
I20260808 08:46:30.526185 20384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "d7aca7bac42e4f738c93d61bf4347d30"
format_stamp: "Formatted at 2026-08-08 08:46:30 on dist-test-slave-39l8"
server_key: "c63d7f92b7da2c6e711f694c2ef6e35f"
server_key_iv: "92becc9a0de68965ea5259586e64aaac"
server_key_version: "encryptionkey@0"
I20260808 08:46:30.532138 20384 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260808 08:46:30.535914 20408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:30.537403 20384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:46:30.537627 20384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "d7aca7bac42e4f738c93d61bf4347d30"
format_stamp: "Formatted at 2026-08-08 08:46:30 on dist-test-slave-39l8"
server_key: "c63d7f92b7da2c6e711f694c2ef6e35f"
server_key_iv: "92becc9a0de68965ea5259586e64aaac"
server_key_version: "encryptionkey@0"
I20260808 08:46:30.537868 20384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:30.556943 20384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:30.561754 20384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:30.562081 20384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:30.583938 20384 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:35181
I20260808 08:46:30.583959 20489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:35181 every 8 connection(s)
I20260808 08:46:30.585597 20384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:30.589015 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20384
I20260808 08:46:30.589203 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:30.589769 20427 external_mini_cluster.cc:1428] Setting key ec1755b89df006445b35436604dcc975
I20260808 08:46:30.590116 20490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:30.606501 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:30.591885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39981 (local address 127.19.242.254:35181)
0808 08:46:30.592875 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:30.592889 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:30.592942 (+ 53us) server_negotiation.cc:407] Connection header received
0808 08:46:30.595483 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:30.595519 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:30.596129 (+ 610us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:30.596631 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:30.597213 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:30.599278 (+ 2065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:30.600710 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:30.601794 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:30.601998 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:30.603418 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:30.603430 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:30.603455 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:30.604273 (+ 818us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:30.604381 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:30.604415 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:30.604534 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:30.604804 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 08:46:30.605112 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":433,"threads_started":1}
I20260808 08:46:30.606606 20490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30: Bootstrap starting.
I20260808 08:46:30.610596 20490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:30.611308 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:30.612176 20490 log.cc:824] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:30.616137 20490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30: No bootstrap required, opened a new log
I20260808 08:46:30.624305 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:30.616903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35955 (local address 127.19.242.254:35181)
0808 08:46:30.617163 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:30.617172 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:30.617773 (+ 601us) server_negotiation.cc:407] Connection header received
0808 08:46:30.617937 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:30.617943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:30.618041 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:30.618164 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:30.618774 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:30.619925 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:30.621274 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:30.622023 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:30.622160 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:30.623329 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:30.623336 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:30.623341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:30.623405 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:30.623460 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:30.623506 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:30.623640 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:30.623818 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 08:46:30.623917 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:46:30.626796 20490 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7aca7bac42e4f738c93d61bf4347d30" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35181 } }
I20260808 08:46:30.627184 20490 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:30.627269 20490 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7aca7bac42e4f738c93d61bf4347d30, State: Initialized, Role: FOLLOWER
I20260808 08:46:30.627842 20490 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7aca7bac42e4f738c93d61bf4347d30" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35181 } }
I20260808 08:46:30.628052 20490 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:30.628150 20490 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:30.628295 20490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:30.631098 20490 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7aca7bac42e4f738c93d61bf4347d30" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35181 } }
I20260808 08:46:30.631637 20490 leader_election.cc:302] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7aca7bac42e4f738c93d61bf4347d30; no voters:
I20260808 08:46:30.632412 20490 leader_election.cc:288] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:30.632568 20506 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:30.633550 20506 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [term 1 LEADER]: Becoming Leader. State: Replica: d7aca7bac42e4f738c93d61bf4347d30, State: Running, Role: LEADER
I20260808 08:46:30.634112 20506 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7aca7bac42e4f738c93d61bf4347d30" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35181 } }
I20260808 08:46:30.634827 20490 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:30.636989 20507 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7aca7bac42e4f738c93d61bf4347d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7aca7bac42e4f738c93d61bf4347d30" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35181 } } }
I20260808 08:46:30.637465 20507 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:30.637277 20508 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7aca7bac42e4f738c93d61bf4347d30. Latest consensus state: current_term: 1 leader_uuid: "d7aca7bac42e4f738c93d61bf4347d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7aca7bac42e4f738c93d61bf4347d30" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 35181 } } }
I20260808 08:46:30.637774 20508 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:30.640410 20515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:30.646726 20515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:30.657094 20515 catalog_manager.cc:1347] Generated new cluster ID: 1f21fdafc5934a7489a3de066dee78f6
I20260808 08:46:30.657239 20515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:30.677397 20515 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:30.679093 20515 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:30.692641 20515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7aca7bac42e4f738c93d61bf4347d30: Generated new TSK 0
I20260808 08:46:30.693619 20515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:30.701069 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20384
W20260808 08:46:30.702394 20483 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39981
W20260808 08:46:30.703313 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20384: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:30.703519 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20384
2026-08-08T08:46:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2432 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:30 dist-test-slave-39l8 krb5kdc[20534](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:30 dist-test-slave-39l8 krb5kdc[20534](info): set up 2 sockets
Aug 08 08:46:30 dist-test-slave-39l8 krb5kdc[20534](info): commencing operation
krb5kdc: starting...
W20260808 08:46:32.174460 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.422s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:32 dist-test-slave-39l8 krb5kdc[20534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:32.558405 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33317
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:33317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:32.931358 20552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:32.931705 20552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:32.931871 20552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:32.939661 20552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:32.939810 20552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:32.939910 20552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:32.940017 20552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:32.940090 20552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:32.950770 20552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:33317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:33317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:32.952343 20552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:32.953758 20552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:32.966504 20562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:32.966617 20559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:32.966483 20560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:32.967635 20552 server_base.cc:1034] running on GCE node
I20260808 08:46:32.968529 20552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:32.970100 20552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:32.971331 20552 hybrid_clock.cc:648] HybridClock initialized: now 1786178792971260 us; error 65 us; skew 500 ppm
I20260808 08:46:32.971725 20552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:32 dist-test-slave-39l8 krb5kdc[20534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178792, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:32.975358 20552 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:32.977152 20552 webserver.cc:460] Webserver started at http://127.19.242.254:35811/ using document root <none> and password file <none>
I20260808 08:46:32.977973 20552 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:32.978124 20552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:32.978472 20552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:32.981920 20552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "985923b713d140439c234946ebe61b85"
format_stamp: "Formatted at 2026-08-08 08:46:32 on dist-test-slave-39l8"
server_key: "2bba42ab4025105483daeec8559d8565"
server_key_iv: "e12c9bcd60f6038b2d01c0d629200040"
server_key_version: "encryptionkey@0"
I20260808 08:46:32.982908 20552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "985923b713d140439c234946ebe61b85"
format_stamp: "Formatted at 2026-08-08 08:46:32 on dist-test-slave-39l8"
server_key: "2bba42ab4025105483daeec8559d8565"
server_key_iv: "e12c9bcd60f6038b2d01c0d629200040"
server_key_version: "encryptionkey@0"
I20260808 08:46:32.989224 20552 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:46:32.993530 20574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:32.995471 20552 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 08:46:32.995695 20552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "985923b713d140439c234946ebe61b85"
format_stamp: "Formatted at 2026-08-08 08:46:32 on dist-test-slave-39l8"
server_key: "2bba42ab4025105483daeec8559d8565"
server_key_iv: "e12c9bcd60f6038b2d01c0d629200040"
server_key_version: "encryptionkey@0"
I20260808 08:46:32.995940 20552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:33.002805 20552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:33.008128 20552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:33.008582 20552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:33.031138 20552 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:33317
I20260808 08:46:33.031181 20657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:33317 every 8 connection(s)
I20260808 08:46:33.032829 20552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:33.036641 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20552
I20260808 08:46:33.036883 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:33.037325 20658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:33.037369 20427 external_mini_cluster.cc:1428] Setting key 019068816a0f3a7ea9f0c4e27fb7af4f
I20260808 08:46:33.046459 20662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:33.039414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40399 (local address 127.19.242.254:33317)
0808 08:46:33.040283 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:33.040295 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:33.040345 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:46:33.042509 (+ 2164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:33.042544 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:33.043065 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:33.043556 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:33.044727 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:33.044734 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:33.044752 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:33.044773 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:33.044833 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:33.044856 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:33.045131 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:33.045282 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 08:46:33.045482 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":383,"threads_started":1}
I20260808 08:46:33.050973 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:33.052619 20658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85: Bootstrap starting.
I20260808 08:46:33.056802 20658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:33.058162 20658 log.cc:824] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:33.058609 20662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:33.055849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52517 (local address 127.19.242.254:33317)
0808 08:46:33.056056 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:33.056063 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:33.056437 (+ 374us) server_negotiation.cc:407] Connection header received
0808 08:46:33.056661 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:33.056665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:33.056721 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:33.056840 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:33.057841 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:33.057846 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:33.057849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:46:33.057870 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:33.057912 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:46:33.057927 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:33.058062 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:33.058277 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 08:46:33.058347 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:46:33.061738 20658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85: No bootstrap required, opened a new log
I20260808 08:46:33.070336 20658 raft_consensus.cc:348] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985923b713d140439c234946ebe61b85" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33317 } }
I20260808 08:46:33.071033 20658 raft_consensus.cc:374] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:46:33.071384 20658 raft_consensus.cc:729] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 985923b713d140439c234946ebe61b85, State: Initialized, Role: FOLLOWER
I20260808 08:46:33.072184 20658 consensus_queue.cc:260] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985923b713d140439c234946ebe61b85" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33317 } }
I20260808 08:46:33.072485 20658 raft_consensus.cc:388] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:46:33.072666 20658 raft_consensus.cc:482] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:46:33.072875 20658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:33.076169 20658 raft_consensus.cc:504] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985923b713d140439c234946ebe61b85" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33317 } }
I20260808 08:46:33.076903 20658 leader_election.cc:302] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 985923b713d140439c234946ebe61b85; no voters:
I20260808 08:46:33.077564 20658 leader_election.cc:288] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:46:33.077767 20675 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:33.078570 20675 raft_consensus.cc:686] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [term 1 LEADER]: Becoming Leader. State: Replica: 985923b713d140439c234946ebe61b85, State: Running, Role: LEADER
I20260808 08:46:33.079313 20675 consensus_queue.cc:237] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985923b713d140439c234946ebe61b85" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33317 } }
I20260808 08:46:33.080070 20658 sys_catalog.cc:564] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:33.082473 20676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "985923b713d140439c234946ebe61b85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985923b713d140439c234946ebe61b85" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33317 } } }
I20260808 08:46:33.082921 20677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 985923b713d140439c234946ebe61b85. Latest consensus state: current_term: 1 leader_uuid: "985923b713d140439c234946ebe61b85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "985923b713d140439c234946ebe61b85" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 33317 } } }
I20260808 08:46:33.083181 20676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:33.083197 20677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:33.084530 20683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:33.102252 20683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:33.118505 20683 catalog_manager.cc:1347] Generated new cluster ID: dfdb55f9dc514da391d11404d4c5e029
I20260808 08:46:33.118831 20683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:33.177044 20683 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:33.177551 20683 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:33.190521 20683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 985923b713d140439c234946ebe61b85: Generated new TSK 0
I20260808 08:46:33.191524 20683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:46:33.198608 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20552
W20260808 08:46:33.199978 20648 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40399
W20260808 08:46:33.200838 20427 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20552: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:46:33.201001 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20552
2026-08-08T08:46:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2493 ms)
[----------] 18 tests from AuthTokenIssuingTest (43564 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:33 dist-test-slave-39l8 krb5kdc[20705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:33 dist-test-slave-39l8 krb5kdc[20705](info): set up 2 sockets
Aug 08 08:46:33 dist-test-slave-39l8 krb5kdc[20705](info): commencing operation
krb5kdc: starting...
W20260808 08:46:34.589303 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.342s user 0.004s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:34 dist-test-slave-39l8 krb5kdc[20705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:34.967093 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42439
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:45555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42439,127.19.242.253:43109,127.19.242.252:37935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:35.343114 20721 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:46:35.343513 20721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:35.343639 20721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:35.343771 20721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:35.351328 20721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:35.351451 20721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:35.351545 20721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:35.351622 20721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:35.351732 20721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:35.362144 20721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:45555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42439,127.19.242.253:43109,127.19.242.252:37935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:35.363673 20721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:35.365094 20721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:35.378252 20728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:35.378451 20735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:35.378387 20730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:35.379770 20721 server_base.cc:1034] running on GCE node
I20260808 08:46:35.380724 20721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:35.382350 20721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:35.383622 20721 hybrid_clock.cc:648] HybridClock initialized: now 1786178795383560 us; error 81 us; skew 500 ppm
I20260808 08:46:35.384008 20721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:35 dist-test-slave-39l8 krb5kdc[20705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:35.387840 20721 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:35.389909 20721 webserver.cc:460] Webserver started at http://127.19.242.254:36517/ using document root <none> and password file <none>
I20260808 08:46:35.390825 20721 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:35.390966 20721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:35.391323 20721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:35.394794 20721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "6b7d9498693b47ec8e7bc387e01aa198"
format_stamp: "Formatted at 2026-08-08 08:46:35 on dist-test-slave-39l8"
server_key: "af02f3ad1a34330f3eec1557fc742e45"
server_key_iv: "b987b3c4c89da941e2d8263fe0061c9e"
server_key_version: "encryptionkey@0"
I20260808 08:46:35.395748 20721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "6b7d9498693b47ec8e7bc387e01aa198"
format_stamp: "Formatted at 2026-08-08 08:46:35 on dist-test-slave-39l8"
server_key: "af02f3ad1a34330f3eec1557fc742e45"
server_key_iv: "b987b3c4c89da941e2d8263fe0061c9e"
server_key_version: "encryptionkey@0"
I20260808 08:46:35.401775 20721 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260808 08:46:35.406013 20742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:35.407759 20721 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:46:35.407996 20721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "6b7d9498693b47ec8e7bc387e01aa198"
format_stamp: "Formatted at 2026-08-08 08:46:35 on dist-test-slave-39l8"
server_key: "af02f3ad1a34330f3eec1557fc742e45"
server_key_iv: "b987b3c4c89da941e2d8263fe0061c9e"
server_key_version: "encryptionkey@0"
I20260808 08:46:35.408270 20721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:35.426124 20721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:35.431041 20721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:35.431419 20721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:35.453701 20721 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:42439
I20260808 08:46:35.453728 20816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:42439 every 8 connection(s)
I20260808 08:46:35.455281 20721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:35.456796 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20721
I20260808 08:46:35.457055 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:35.457988 20427 external_mini_cluster.cc:1428] Setting key 8528d987301e192514c63f7dd65e046f
I20260808 08:46:35.461054 20817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:35.472137 20817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:35 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.253@KRBTEST.COM" created.
I20260808 08:46:35.498381 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.476982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42439 (local address 127.0.0.1:56678)
0808 08:46:35.478202 (+ 1220us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.478239 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:35.480195 (+ 1956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:35.481109 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:35.481116 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:35.481904 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:35.482282 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:35.482302 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:35.484026 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:35.484030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:35.485155 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:35.485168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:35.486173 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:35.486180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:35.486378 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:35.487194 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:35.487220 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:35.489923 (+ 2703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:35.493604 (+ 3681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:35.493618 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:35.493631 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:35.494142 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:35.494573 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:35.494581 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:35.494584 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:35.494797 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:35.495705 (+ 908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:35.495720 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:35.495980 (+ 260us) client_negotiation.cc:769] Sending connection context
0808 08:46:35.496271 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 08:46:35.496920 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":996,"mutex_wait_us":171,"thread_start_us":766,"threads_started":1}
I20260808 08:46:35.498402 20821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.476978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56678 (local address 127.19.242.254:42439)
0808 08:46:35.477899 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:35.477916 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:35.478373 (+ 457us) server_negotiation.cc:407] Connection header received
0808 08:46:35.480611 (+ 2238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:35.480617 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:35.480861 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:35.481081 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:35.482526 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:35.483838 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:35.485317 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:35.485902 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:35.486109 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:35.490188 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:35.490198 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:35.490212 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:35.490245 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:35.493450 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:35.494286 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:35.494294 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:35.494296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:35.494450 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:35.494908 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:35.494916 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:35.494919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:35.495489 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:35.495783 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:35.496399 (+ 616us) server_negotiation.cc:299] Negotiation successful
0808 08:46:35.496794 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":643,"thread_start_us":392,"threads_started":1}
I20260808 08:46:35.502436 20817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:46:35.503906 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.503442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53144)
0808 08:46:35.503643 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.503768 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 08:46:35.504232 20745 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
I20260808 08:46:35.506160 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.505666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53154)
0808 08:46:35.505903 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.505998 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 08:46:35.506407 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43109: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab.
Entry for principal kudu/127.19.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab.
I20260808 08:46:35.538655 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:43109
--webserver_interface=127.19.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab
--principal=kudu/127.19.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:45555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42439,127.19.242.253:43109,127.19.242.252:37935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:46:35.555858 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } attempt: 1
I20260808 08:46:35.557317 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.556677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53156)
0808 08:46:35.556949 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.557115 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 08:46:35.558753 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.558188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53164)
0808 08:46:35.558397 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.558506 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 08:46:35.559005 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43109: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
I20260808 08:46:35.627359 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } attempt: 2
I20260808 08:46:35.628756 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.628230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53166)
0808 08:46:35.628498 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.628594 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 08:46:35.629940 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.629557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53174)
0808 08:46:35.629725 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.629811 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:46:35.630221 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43109: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
I20260808 08:46:35.721529 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } attempt: 3
I20260808 08:46:35.722836 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.722292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53190)
0808 08:46:35.722507 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.722612 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 08:46:35.724249 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.723772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53202)
0808 08:46:35.723974 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.724063 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 08:46:35.724545 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43109: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
I20260808 08:46:35.867906 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } attempt: 4
I20260808 08:46:35.869223 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.868617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53206)
0808 08:46:35.868979 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.869073 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260808 08:46:35.870401 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:35.870018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53212)
0808 08:46:35.870170 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:35.870267 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:46:35.870649 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:43109: Network error: Client connection negotiation failed: client connection to 127.19.242.253:43109: connect: Connection refused (error 111)
W20260808 08:46:35.916877 20825 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:46:35.917297 20825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:35.917419 20825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:35.917568 20825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:35.925176 20825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:35.925299 20825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:35.925390 20825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:35.925477 20825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:35.925588 20825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:35.935915 20825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:45555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42439,127.19.242.253:43109,127.19.242.252:37935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab
--principal=kudu/127.19.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:43109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:35.937368 20825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:35.938877 20825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:35.951284 20832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:35.951380 20833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:35.951408 20836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:35.952692 20825 server_base.cc:1034] running on GCE node
I20260808 08:46:35.953617 20825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:35.955231 20825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:35.956456 20825 hybrid_clock.cc:648] HybridClock initialized: now 1786178795956373 us; error 63 us; skew 500 ppm
I20260808 08:46:35.956772 20825 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:35 dist-test-slave-39l8 krb5kdc[20705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:35.965466 20825 init.cc:377] Logged in from keytab as kudu/127.19.242.253@KRBTEST.COM (short username kudu)
I20260808 08:46:35.967404 20825 webserver.cc:460] Webserver started at http://127.19.242.253:46189/ using document root <none> and password file <none>
I20260808 08:46:35.968225 20825 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:35.968329 20825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:35.968648 20825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:35.972200 20825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data/instance:
uuid: "26f9e916f07d47149208f810f3ddc69a"
format_stamp: "Formatted at 2026-08-08 08:46:35 on dist-test-slave-39l8"
server_key: "c41a7e1c0cea212eca24f6f62b2af13a"
server_key_iv: "920b47844ba12abf0a30727939076ced"
server_key_version: "encryptionkey@0"
I20260808 08:46:35.973091 20825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/wal/instance:
uuid: "26f9e916f07d47149208f810f3ddc69a"
format_stamp: "Formatted at 2026-08-08 08:46:35 on dist-test-slave-39l8"
server_key: "c41a7e1c0cea212eca24f6f62b2af13a"
server_key_iv: "920b47844ba12abf0a30727939076ced"
server_key_version: "encryptionkey@0"
I20260808 08:46:35.979470 20825 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:46:35.983575 20846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:35.985267 20825 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260808 08:46:35.985451 20825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/wal
uuid: "26f9e916f07d47149208f810f3ddc69a"
format_stamp: "Formatted at 2026-08-08 08:46:35 on dist-test-slave-39l8"
server_key: "c41a7e1c0cea212eca24f6f62b2af13a"
server_key_iv: "920b47844ba12abf0a30727939076ced"
server_key_version: "encryptionkey@0"
I20260808 08:46:35.985664 20825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:36.011523 20825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:36.018893 20825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:36.019302 20825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:36.041633 20825 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.253:43109
I20260808 08:46:36.041656 20918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.253:43109 every 8 connection(s)
I20260808 08:46:36.043224 20825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
I20260808 08:46:36.047668 20919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:36.048327 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20825
I20260808 08:46:36.048552 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-1/wal/instance
I20260808 08:46:36.049058 20427 external_mini_cluster.cc:1428] Setting key ee30543626c00b04e00edcdc0100db10
I20260808 08:46:36.055315 20919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:36.083812 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.058531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56680 (local address 127.19.242.254:42439)
0808 08:46:36.059170 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.059178 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.060386 (+ 1208us) server_negotiation.cc:407] Connection header received
0808 08:46:36.063663 (+ 3277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.063668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.063756 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.063859 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.066200 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.067621 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.069320 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.070244 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.070426 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.074617 (+ 4191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.074628 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.074637 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.074738 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.079501 (+ 4763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.080587 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.080596 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.080603 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.080835 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.081370 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.081379 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.081386 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.081863 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.082046 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.082905 (+ 859us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.083217 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":318,"threads_started":1}
I20260808 08:46:36.084527 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.059252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42439 (local address 127.0.0.1:56680)
0808 08:46:36.060170 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.060228 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.063203 (+ 2975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.064193 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.064209 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.065140 (+ 931us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.065890 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.065910 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.067830 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.067835 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.069125 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.069140 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.070527 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.070533 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.070860 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.071707 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.071738 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.074281 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.079766 (+ 5485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.079776 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.079795 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.080412 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.080989 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.080993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.080996 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.081234 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.082008 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.082016 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.082431 (+ 415us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.082798 (+ 367us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.083282 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":341,"threads_started":1}
I20260808 08:46:36.086988 20919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.242.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.252@KRBTEST.COM" created.
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:46:36.104811 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.088031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53226)
0808 08:46:36.088293 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.088322 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.088465 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.089859 (+ 1394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.089866 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.090510 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.090680 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.090690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.092435 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.092440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.093469 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.093483 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.094536 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.094543 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.094795 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.095489 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.095511 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.097972 (+ 2461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.101831 (+ 3859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.101839 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.101843 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.102280 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.102754 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.102760 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.102764 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.102903 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.103612 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.103617 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.103803 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.103954 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.104297 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":1}
I20260808 08:46:36.104882 20925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.088201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53226 (local address 127.19.242.253:43109)
0808 08:46:36.089129 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.089142 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.089186 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:46:36.089261 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.089270 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.089641 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.089875 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.090936 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.092288 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.093639 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.094354 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.094520 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.098248 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.098267 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.098286 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.098323 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.101639 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.102444 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.102453 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.102455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.102585 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.103024 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.103032 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.103036 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.103457 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.103718 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.104115 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.104441 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":678,"thread_start_us":493,"threads_started":1}
I20260808 08:46:36.108265 20919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:46:36.109731 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.109217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48742)
0808 08:46:36.109411 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.109548 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 08:46:36.110065 20847 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.112246 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.111707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48758)
0808 08:46:36.111905 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.112014 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 08:46:36.112576 20919 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab.
Entry for principal kudu/127.19.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab.
I20260808 08:46:36.138042 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:37935
--webserver_interface=127.19.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab
--principal=kudu/127.19.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:45555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42439,127.19.242.253:43109,127.19.242.252:37935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:46:36.161957 20919 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 1
I20260808 08:46:36.163472 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.162842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48760)
0808 08:46:36.163098 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.163244 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:46:36.164870 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.164390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48768)
0808 08:46:36.164592 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.164707 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:46:36.165130 20919 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.169965 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } attempt: 5
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:46:36.184285 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.170799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53234)
0808 08:46:36.171023 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.171046 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.171212 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.171581 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.171586 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.172040 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.172230 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.172243 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.173279 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.173285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.174191 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.174205 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.175000 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.175007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.175227 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.175936 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.175956 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.178079 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.181607 (+ 3528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.181613 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.181617 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.182060 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.182488 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.182494 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.182497 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.182640 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.183235 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.183240 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.183402 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.183558 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.183922 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 08:46:36.184283 20925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.170828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53234 (local address 127.19.242.253:43109)
0808 08:46:36.171023 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.171030 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.171135 (+ 105us) server_negotiation.cc:407] Connection header received
0808 08:46:36.171347 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.171352 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.171436 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.171543 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.172394 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.173109 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.174342 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.174841 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.174979 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.178310 (+ 3331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.178315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.178318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.178356 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.181317 (+ 2961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.182199 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.182205 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.182209 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.182363 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.182807 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.182811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.182814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.183108 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.183280 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.183669 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.183923 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:46:36.185714 20817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:46:36.186905 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.186442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48776)
0808 08:46:36.186623 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.186758 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:46:36.187907 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.187569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48784)
0808 08:46:36.187702 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.187792 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:46:36.188184 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.233407 20919 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 2
I20260808 08:46:36.234917 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.234237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48796)
0808 08:46:36.234511 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.234648 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 08:46:36.236285 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.235765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48808)
0808 08:46:36.235968 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.236103 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:46:36.236562 20919 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.239418 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 1
I20260808 08:46:36.240631 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.240153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48824)
0808 08:46:36.240373 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.240468 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 08:46:36.241673 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.241319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48840)
0808 08:46:36.241476 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.241560 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 08:46:36.241899 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.310148 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 2
I20260808 08:46:36.311642 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.311065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48848)
0808 08:46:36.311327 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.311429 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 08:46:36.312980 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.312540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48858)
0808 08:46:36.312756 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.312848 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:46:36.313285 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.327821 20919 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 3
I20260808 08:46:36.329329 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.328586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48870)
0808 08:46:36.328891 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.329051 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 08:46:36.330943 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.330270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48874)
0808 08:46:36.330584 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.330742 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
W20260808 08:46:36.331264 20919 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.419569 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 3
I20260808 08:46:36.420849 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.420347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48886)
0808 08:46:36.420570 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.420671 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 08:46:36.422005 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.421610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48894)
0808 08:46:36.421818 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.421897 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260808 08:46:36.422231 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.474617 20919 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 4
I20260808 08:46:36.476017 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.475397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48898)
0808 08:46:36.475692 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.475810 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 08:46:36.477268 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.476819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48914)
0808 08:46:36.477000 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.477103 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:46:36.477507 20919 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
W20260808 08:46:36.522560 20928 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:46:36.522946 20928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:36.523021 20928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:36.523113 20928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:36.530746 20928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:36.530857 20928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:36.530918 20928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:36.530970 20928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:36.531039 20928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:36.541509 20928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:45555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42439,127.19.242.253:43109,127.19.242.252:37935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab
--principal=kudu/127.19.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:37935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:36.542992 20928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:36.544387 20928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:36.557355 20934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:36.557392 20938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:36.557310 20940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:36.558610 20928 server_base.cc:1034] running on GCE node
I20260808 08:46:36.559588 20928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:36.561182 20928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:36.562453 20928 hybrid_clock.cc:648] HybridClock initialized: now 1786178796562366 us; error 65 us; skew 500 ppm
I20260808 08:46:36.562885 20928 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:36.566725 20928 init.cc:377] Logged in from keytab as kudu/127.19.242.252@KRBTEST.COM (short username kudu)
I20260808 08:46:36.575712 20928 webserver.cc:460] Webserver started at http://127.19.242.252:41225/ using document root <none> and password file <none>
I20260808 08:46:36.576577 20928 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:36.576722 20928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:36.577103 20928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:36.580543 20928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data/instance:
uuid: "31f22e93db43438cbc9b43c8fd6345af"
format_stamp: "Formatted at 2026-08-08 08:46:36 on dist-test-slave-39l8"
server_key: "e3beb6eb66056f5b52981535d34e89d6"
server_key_iv: "e84f22dfb234c7fb6c4a0390496672a3"
server_key_version: "encryptionkey@0"
I20260808 08:46:36.581481 20928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/wal/instance:
uuid: "31f22e93db43438cbc9b43c8fd6345af"
format_stamp: "Formatted at 2026-08-08 08:46:36 on dist-test-slave-39l8"
server_key: "e3beb6eb66056f5b52981535d34e89d6"
server_key_iv: "e84f22dfb234c7fb6c4a0390496672a3"
server_key_version: "encryptionkey@0"
I20260808 08:46:36.587419 20928 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:46:36.591517 20952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:36.593111 20928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:46:36.593472 20928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/wal
uuid: "31f22e93db43438cbc9b43c8fd6345af"
format_stamp: "Formatted at 2026-08-08 08:46:36 on dist-test-slave-39l8"
server_key: "e3beb6eb66056f5b52981535d34e89d6"
server_key_iv: "e84f22dfb234c7fb6c4a0390496672a3"
server_key_version: "encryptionkey@0"
I20260808 08:46:36.593775 20928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:36.599453 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 4
I20260808 08:46:36.600771 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.600203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48922)
0808 08:46:36.600453 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.600578 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 08:46:36.602098 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.601613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48924)
0808 08:46:36.601791 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.601900 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:46:36.602366 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:37935: Network error: Client connection negotiation failed: client connection to 127.19.242.252:37935: connect: Connection refused (error 111)
I20260808 08:46:36.624657 20928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:36.629940 20928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:36.630218 20928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:36.667892 20928 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.252:37935
I20260808 08:46:36.667901 21019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.252:37935 every 8 connection(s)
I20260808 08:46:36.670845 20928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
I20260808 08:46:36.678018 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 20928
I20260808 08:46:36.678368 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178398071314-20427-0/minicluster-data/master-2/wal/instance
I20260808 08:46:36.679626 20427 external_mini_cluster.cc:1428] Setting key c9949cc14c2f457178b23f1ff964a3fc
I20260808 08:46:36.682071 21020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:36.705673 21020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:36.731565 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.684748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48930 (local address 127.19.242.252:37935)
0808 08:46:36.687627 (+ 2879us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.687650 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.687738 (+ 88us) server_negotiation.cc:407] Connection header received
0808 08:46:36.693368 (+ 5630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.693427 (+ 59us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.694371 (+ 944us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.695178 (+ 807us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.699845 (+ 4667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.702215 (+ 2370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.706506 (+ 4291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.708030 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.708532 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.717745 (+ 9213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.717764 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.717793 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.717863 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.723250 (+ 5387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.724569 (+ 1319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.724586 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.724600 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.724916 (+ 316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.725644 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.725651 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.725653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.726803 (+ 1150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.727386 (+ 583us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.728245 (+ 859us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.729303 (+ 1058us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2491,"thread_start_us":1908,"threads_started":1}
I20260808 08:46:36.742419 21026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.711603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56694 (local address 127.19.242.254:42439)
0808 08:46:36.712873 (+ 1270us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.712897 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.713962 (+ 1065us) server_negotiation.cc:407] Connection header received
0808 08:46:36.714436 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.714454 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.714604 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.714971 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.717451 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.718937 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.721852 (+ 2915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.722678 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.723065 (+ 387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.729924 (+ 6859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.729932 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.729936 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.730010 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.735810 (+ 5800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.737510 (+ 1700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.737527 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.737541 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.737981 (+ 440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.738934 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.738941 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.738945 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.739854 (+ 909us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.740089 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.741464 (+ 1375us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.741797 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":960,"thread_start_us":628,"threads_started":1}
I20260808 08:46:36.743214 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.711844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42439 (local address 127.0.0.1:56694)
0808 08:46:36.713699 (+ 1855us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.713807 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.714152 (+ 345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.715081 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.715103 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.716615 (+ 1512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.717134 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.717162 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.719272 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.719286 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.721484 (+ 2198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.721516 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.723147 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.723168 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.723550 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.724634 (+ 1084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.724682 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.729487 (+ 4805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.736124 (+ 6637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.736140 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.736148 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.737200 (+ 1052us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.738317 (+ 1117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.738323 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.738327 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.738674 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.740166 (+ 1492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.740191 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.740748 (+ 557us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.741245 (+ 497us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.742119 (+ 874us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1273,"thread_start_us":872,"threads_started":1}
I20260808 08:46:36.746254 21020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:46:36.771122 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.737563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56708 (local address 127.19.242.254:42439)
0808 08:46:36.738882 (+ 1319us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.738892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.738926 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:46:36.738996 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.739009 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.739199 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.739448 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.742938 (+ 3490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.745122 (+ 2184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.749147 (+ 4025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.749954 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.750232 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.759226 (+ 8994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.759241 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.759245 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.759321 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.764996 (+ 5675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.766395 (+ 1399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.766419 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.766421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.766932 (+ 511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.768138 (+ 1206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.768143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.768145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.768733 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.769433 (+ 700us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.770102 (+ 669us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.770443 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":972,"thread_start_us":605,"threads_started":1}
I20260808 08:46:36.776795 20919 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 5
I20260808 08:46:36.779902 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.747954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:43109 (local address 127.0.0.1:53248)
0808 08:46:36.748315 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.748348 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.748586 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.749706 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.749735 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.750803 (+ 1068us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.751405 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.751454 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.754060 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.754094 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.756719 (+ 2625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.756768 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.758228 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.758259 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.758972 (+ 713us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.760230 (+ 1258us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.760282 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.764945 (+ 4663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.773035 (+ 8090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.773062 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.773068 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.774076 (+ 1008us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.775397 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.775419 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.775435 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.776002 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.777545 (+ 1543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.777567 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.778106 (+ 539us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.778429 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.779157 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106}
I20260808 08:46:36.780923 21030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.748050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53248 (local address 127.19.242.253:43109)
0808 08:46:36.749068 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.749088 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.749123 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:46:36.749222 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.749228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.749373 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.749613 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.752059 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.753784 (+ 1725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.757092 (+ 3308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.757889 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.758061 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.765435 (+ 7374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.765450 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.765455 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.765534 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.772717 (+ 7183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.774392 (+ 1675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.774412 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.774416 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.774933 (+ 517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.776284 (+ 1351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.776289 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.776299 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.776993 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.777415 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.779446 (+ 2031us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.779926 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":678,"threads_started":1}
I20260808 08:46:36.782562 21020 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178796, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
I20260808 08:46:36.817952 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.774860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53254 (local address 127.19.242.253:43109)
0808 08:46:36.776499 (+ 1639us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.776506 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.776554 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:46:36.776639 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.776645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.776735 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.777010 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.782109 (+ 5099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.784426 (+ 2317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.787719 (+ 3293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.789482 (+ 1763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.789873 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.801131 (+ 11258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.801148 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.801165 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.801275 (+ 110us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.807599 (+ 6324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.808985 (+ 1386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.808998 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.809002 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.809284 (+ 282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.810384 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.810396 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.810403 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.811944 (+ 1541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.812946 (+ 1002us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.815339 (+ 2393us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.816315 (+ 976us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":13,"server-negotiator.queue_time_us":1403,"thread_start_us":949,"threads_started":1}
I20260808 08:46:36.822434 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.781609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48938 (local address 127.19.242.252:37935)
0808 08:46:36.782043 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.782065 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.782110 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:46:36.782255 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.782265 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.782416 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.782666 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.785621 (+ 2955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.787919 (+ 2298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.790895 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.792906 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.793333 (+ 427us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.802368 (+ 9035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.802381 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.802403 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.802523 (+ 120us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.811990 (+ 9467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.814317 (+ 2327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.814331 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.814334 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.814692 (+ 358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.816509 (+ 1817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.816535 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.816551 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.818059 (+ 1508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.819243 (+ 1184us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.820418 (+ 1175us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.821256 (+ 838us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":149,"server-negotiator.queue_time_us":153,"spinlock_wait_cycles":102656}
I20260808 08:46:36.822818 20922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.778006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48938)
0808 08:46:36.778589 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.778630 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.778920 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.782771 (+ 3851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.782803 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.783863 (+ 1060us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.785072 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.785176 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.788223 (+ 3047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.788239 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.790453 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.790485 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.793889 (+ 3404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.793914 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.794501 (+ 587us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.795751 (+ 1250us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.795884 (+ 133us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.801825 (+ 5941us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.812716 (+ 10891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.812722 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.812725 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.813933 (+ 1208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.815335 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.815352 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.815370 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.815924 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.818533 (+ 2609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.818552 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.819393 (+ 841us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.820097 (+ 704us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.821249 (+ 1152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":4}
I20260808 08:46:36.822659 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.784669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48950)
0808 08:46:36.785315 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.785354 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.787247 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.788870 (+ 1623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.788877 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.789976 (+ 1099us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.790381 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.790416 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.794480 (+ 4064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.794499 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.797505 (+ 3006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.797530 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.798966 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.798985 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.799352 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.800465 (+ 1113us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.800542 (+ 77us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.805057 (+ 4515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.815785 (+ 10728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.815810 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.815819 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.816824 (+ 1005us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.817614 (+ 790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.817628 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.817633 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.817968 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.819709 (+ 1741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.819748 (+ 39us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.820116 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.820599 (+ 483us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.821655 (+ 1056us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":128}
I20260808 08:46:36.825685 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.785775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48950 (local address 127.19.242.252:37935)
0808 08:46:36.787624 (+ 1849us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.787651 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.787689 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:46:36.787800 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.787805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.787959 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.788172 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.790968 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.794109 (+ 3141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.797833 (+ 3724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.798630 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.798936 (+ 306us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.805518 (+ 6582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.805529 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.805535 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.805626 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.815267 (+ 9641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.817112 (+ 1845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.817116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.817118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.817353 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.818186 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.818213 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.818227 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.819295 (+ 1068us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.822899 (+ 3604us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.823359 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.824997 (+ 1638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":101,"server-negotiator.queue_time_us":1539,"thread_start_us":991,"threads_started":1}
I20260808 08:46:36.835238 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:36.837689 21020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: Bootstrap starting.
I20260808 08:46:36.839783 20919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: Bootstrap starting.
I20260808 08:46:36.845721 21020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:36.849942 21020 log.cc:824] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:36.853106 20919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:36.855779 20919 log.cc:824] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:36.858232 21020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: No bootstrap required, opened a new log
I20260808 08:46:36.850843 20785 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6b7d9498693b47ec8e7bc387e01aa198"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56708
I20260808 08:46:36.861642 20919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: No bootstrap required, opened a new log
I20260808 08:46:36.879696 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } attempt: 5
I20260808 08:46:36.879040 20919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:36.880393 20919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26f9e916f07d47149208f810f3ddc69a, State: Initialized, Role: FOLLOWER
I20260808 08:46:36.882179 20919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:36.886247 21039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:36.887643 21039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:36.889860 20919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:36.890777 21020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:36.892212 21020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f22e93db43438cbc9b43c8fd6345af, State: Initialized, Role: FOLLOWER
I20260808 08:46:36.893906 21020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:36.903720 21020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 08:46:36 dist-test-slave-39l8 krb5kdc[20705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178795, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
I20260808 08:46:36.902956 21044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:36.912410 21044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:36.932965 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.881691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:37935 (local address 127.0.0.1:48954)
0808 08:46:36.882505 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:36.882570 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:36.884199 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:36.885737 (+ 1538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:36.885764 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:36.887250 (+ 1486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:36.887942 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.887979 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.893693 (+ 5714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.893721 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.900040 (+ 6319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:36.900110 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.904384 (+ 4274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.904422 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:36.905163 (+ 741us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.907069 (+ 1906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:36.907128 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:36.913761 (+ 6633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:36.925300 (+ 11539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.925322 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.925338 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.926405 (+ 1067us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.927573 (+ 1168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:36.927594 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:36.927601 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:36.928053 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:36.929430 (+ 1377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:36.929444 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:36.929934 (+ 490us) client_negotiation.cc:769] Sending connection context
0808 08:46:36.931200 (+ 1266us) client_negotiation.cc:240] Negotiation successful
0808 08:46:36.931862 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487}
W20260808 08:46:36.942231 21062 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:46:36.942552 21062 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:46:36.945598 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:36.881966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48954 (local address 127.19.242.252:37935)
0808 08:46:36.882642 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:36.882662 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:36.882822 (+ 160us) server_negotiation.cc:407] Connection header received
0808 08:46:36.884775 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:36.884801 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:36.885092 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:36.888815 (+ 3723us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:36.889483 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.893140 (+ 3657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.900776 (+ 7636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:36.903045 (+ 2269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:36.903458 (+ 413us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:36.914758 (+ 11300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:36.914772 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:36.914779 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:36.914900 (+ 121us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:36.924724 (+ 9824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.926782 (+ 2058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.926801 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.926807 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.927211 (+ 404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:36.928383 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:36.928397 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:36.928401 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:36.929195 (+ 794us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:36.929474 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:36.934485 (+ 5011us) server_negotiation.cc:299] Negotiation successful
0808 08:46:36.935245 (+ 760us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260808 08:46:36.967260 20817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198: Bootstrap starting.
W20260808 08:46:36.971508 21071 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:46:36.971890 21071 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:46:36.984253 20817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:36.990221 20817 log.cc:824] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:36.953938 20928 master_runner.cc:186] Error getting master registration for 127.19.242.254:42439: OK, instance_id { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" instance_seqno: 1786178795447738 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:46:37.002405 20928 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:46:36.939877 20825 master_runner.cc:186] Error getting master registration for 127.19.242.254:42439: OK, instance_id { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" instance_seqno: 1786178795447738 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:46:37.003754 20825 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:46:37.012630 20817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198: No bootstrap required, opened a new log
W20260808 08:46:37.023181 20853 tablet.cc:2369] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:46:37.028847 20817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:37.029911 20817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b7d9498693b47ec8e7bc387e01aa198, State: Initialized, Role: FOLLOWER
I20260808 08:46:37.031109 20817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:37.039275 21074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.040098 21074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:37.043980 20817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:37.055131 20785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:46:37.055894 20785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:37.068764 20785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:37.087430 20882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b7d9498693b47ec8e7bc387e01aa198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "26f9e916f07d47149208f810f3ddc69a"
I20260808 08:46:37.088529 20882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:37.095660 20882 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9498693b47ec8e7bc387e01aa198 in term 1.
I20260808 08:46:37.097692 20745 leader_election.cc:302] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26f9e916f07d47149208f810f3ddc69a, 6b7d9498693b47ec8e7bc387e01aa198; no voters:
I20260808 08:46:37.098785 21074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:37.101766 20989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6b7d9498693b47ec8e7bc387e01aa198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "31f22e93db43438cbc9b43c8fd6345af"
I20260808 08:46:37.102775 20989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:37.107462 21074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [term 1 LEADER]: Becoming Leader. State: Replica: 6b7d9498693b47ec8e7bc387e01aa198, State: Running, Role: LEADER
I20260808 08:46:37.108671 21074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } }
I20260808 08:46:37.111636 20989 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b7d9498693b47ec8e7bc387e01aa198 in term 1.
I20260808 08:46:37.112221 20785 leader_election.cc:288] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [CANDIDATE]: Term 1 election: Requested vote from peers 26f9e916f07d47149208f810f3ddc69a (127.19.242.253:43109), 31f22e93db43438cbc9b43c8fd6345af (127.19.242.252:37935)
I20260808 08:46:37.122061 21084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b7d9498693b47ec8e7bc387e01aa198. Latest consensus state: current_term: 1 leader_uuid: "6b7d9498693b47ec8e7bc387e01aa198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.123436 21084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: This master's current role is: LEADER
W20260808 08:46:37.133525 20960 tablet.cc:2369] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:46:37.147375 21091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:46:37.169310 21091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260808 08:46:37.189981 20750 tablet.cc:2369] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:46:37.220429 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:37.151526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56718 (local address 127.19.242.254:42439)
0808 08:46:37.151941 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.151952 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.168614 (+ 16662us) server_negotiation.cc:407] Connection header received
0808 08:46:37.173861 (+ 5247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.173871 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.174115 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.174284 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.185006 (+ 10722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.188946 (+ 3940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.193162 (+ 4216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.194446 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.194655 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:37.203698 (+ 9043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:37.203710 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:37.203727 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:37.203841 (+ 114us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:37.212047 (+ 8206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:37.214229 (+ 2182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:37.214240 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:37.214245 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:37.214530 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:37.215690 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:37.215702 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:37.215710 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:37.216723 (+ 1013us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:37.217293 (+ 570us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:37.219081 (+ 1788us) server_negotiation.cc:299] Negotiation successful
0808 08:46:37.219698 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260808 08:46:37.245606 20882 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9498693b47ec8e7bc387e01aa198: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:46:37.247503 20989 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [term 1 FOLLOWER]: Refusing update from remote peer 6b7d9498693b47ec8e7bc387e01aa198: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:46:37.249936 21084 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:46:37.256088 21084 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:46:37.286978 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:37.138406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53270 (local address 127.19.242.253:43109)
0808 08:46:37.138790 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.138810 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.159408 (+ 20598us) server_negotiation.cc:407] Connection header received
0808 08:46:37.166979 (+ 7571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.167005 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.167180 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.167360 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.179984 (+ 12624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.181937 (+ 1953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.208043 (+ 26106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.209211 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.209448 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:37.235225 (+ 25777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:37.235241 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:37.235247 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:37.235372 (+ 125us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:37.268402 (+ 33030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:37.270989 (+ 2587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:37.271026 (+ 37us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:37.271044 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:37.271502 (+ 458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:37.272979 (+ 1477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:37.272986 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:37.272989 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:37.273953 (+ 964us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:37.279548 (+ 5595us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:37.279945 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 08:46:37.285905 (+ 5960us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:46:37.292104 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:37.140632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48956 (local address 127.19.242.252:37935)
0808 08:46:37.140955 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.140962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.160592 (+ 19630us) server_negotiation.cc:407] Connection header received
0808 08:46:37.162612 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.162621 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.162854 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.163013 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.179917 (+ 16904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.182496 (+ 2579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.190742 (+ 8246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.192199 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.192407 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:37.227124 (+ 34717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:37.227140 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:37.227146 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:37.227226 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:37.278102 (+ 50876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:37.283639 (+ 5537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:37.283674 (+ 35us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:37.283680 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:37.284232 (+ 552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:37.285541 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:37.285579 (+ 38us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:37.285595 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:37.286505 (+ 910us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:37.287269 (+ 764us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:37.290517 (+ 3248us) server_negotiation.cc:299] Negotiation successful
0808 08:46:37.291123 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:46:37.317848 21039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b7d9498693b47ec8e7bc387e01aa198. Latest consensus state: current_term: 1 leader_uuid: "6b7d9498693b47ec8e7bc387e01aa198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.318651 21039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:37.329282 21111 mvcc.cc:205] Tried to move back new op lower bound from 7316188353485086720 to 7316188352968642560. Current Snapshot: MvccSnapshot[applied={T|T < 7316188353485086720}]
I20260808 08:46:37.345248 21039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b7d9498693b47ec8e7bc387e01aa198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.346249 21039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:37.347396 21074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b7d9498693b47ec8e7bc387e01aa198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.348165 21074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:37.350087 21113 mvcc.cc:205] Tried to move back new op lower bound from 7316188353485086720 to 7316188352968642560. Current Snapshot: MvccSnapshot[applied={T|T < 7316188353485086720 or (T in {7316188353485086720})}]
I20260808 08:46:37.352826 21091 catalog_manager.cc:1347] Generated new cluster ID: a14c5ff24e814495b22e71183669755c
I20260808 08:46:37.353026 21091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:37.356628 21044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b7d9498693b47ec8e7bc387e01aa198. Latest consensus state: current_term: 1 leader_uuid: "6b7d9498693b47ec8e7bc387e01aa198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.357329 21044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:37.364327 21084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b7d9498693b47ec8e7bc387e01aa198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.366096 21084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198 [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:37.368646 21114 mvcc.cc:205] Tried to move back new op lower bound from 7316188353485086720 to 7316188352968642560. Current Snapshot: MvccSnapshot[applied={T|T < 7316188353485086720}]
I20260808 08:46:37.384196 21044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b7d9498693b47ec8e7bc387e01aa198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b7d9498693b47ec8e7bc387e01aa198" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42439 } } peers { permanent_uuid: "26f9e916f07d47149208f810f3ddc69a" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 43109 } } peers { permanent_uuid: "31f22e93db43438cbc9b43c8fd6345af" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 37935 } } }
I20260808 08:46:37.384716 21044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:37.493968 21091 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:37.498485 21091 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:37.561746 21091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b7d9498693b47ec8e7bc387e01aa198: Generated new TSK 0
I20260808 08:46:37.566021 21091 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:46:37.741726 20427 mini_kdc.cc:348] Time spent kdestroy: real 0.149s user 0.000s sys 0.059s
W20260808 08:46:37.826584 21033 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:37.792879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48964 (local address 127.19.242.252:37935)
0808 08:46:37.793262 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.793285 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.822424 (+ 29139us) server_negotiation.cc:407] Connection header received
0808 08:46:37.823135 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.823144 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.823288 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.823406 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.826057 (+ 2651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48964: BlockingRecv error: recv got EOF from 127.0.0.1:48964 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260808 08:46:37.833381 21031 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:37.784851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.19.242.253:43109)
0808 08:46:37.785231 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.785239 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.821170 (+ 35931us) server_negotiation.cc:407] Connection header received
0808 08:46:37.830113 (+ 8943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.830131 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.830338 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.830487 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.832840 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53278: BlockingRecv error: recv got EOF from 127.0.0.1:53278 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
W20260808 08:46:37.838784 21142 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:37.803942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56734 (local address 127.19.242.254:42439)
0808 08:46:37.828541 (+ 24599us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.828560 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.834876 (+ 6316us) server_negotiation.cc:407] Connection header received
0808 08:46:37.835020 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.835026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.835236 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.835410 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.838101 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56734: BlockingRecv error: recv got EOF from 127.0.0.1:56734 (error 108)
Metrics: {"server-negotiator.queue_time_us":24295,"thread_start_us":24624,"threads_started":1}
W20260808 08:46:37.893836 21031 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:37.877664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53292 (local address 127.19.242.253:43109)
0808 08:46:37.878046 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.878064 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.888971 (+ 10907us) server_negotiation.cc:407] Connection header received
0808 08:46:37.890306 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.890326 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.890657 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.890888 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.893381 (+ 2493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53292: BlockingRecv error: recv got EOF from 127.0.0.1:53292 (error 108)
Metrics: {"server-negotiator.queue_time_us":148}
W20260808 08:46:37.947979 21031 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:37.931863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53300 (local address 127.19.242.253:43109)
0808 08:46:37.932332 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.932342 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.943742 (+ 11400us) server_negotiation.cc:407] Connection header received
0808 08:46:37.944813 (+ 1071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.944821 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.945009 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.945182 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:37.947367 (+ 2185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53300: BlockingRecv error: recv got EOF from 127.0.0.1:53300 (error 108)
Metrics: {"server-negotiator.queue_time_us":155}
I20260808 08:46:37.948606 21062 catalog_manager.cc:1259] Loaded cluster ID: a14c5ff24e814495b22e71183669755c
I20260808 08:46:37.948825 21062 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: loading cluster ID for follower catalog manager: success
I20260808 08:46:37.956727 21062 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: acquiring CA information for follower catalog manager: success
I20260808 08:46:37.963729 21062 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 26f9e916f07d47149208f810f3ddc69a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:46:37.976527 21071 catalog_manager.cc:1259] Loaded cluster ID: a14c5ff24e814495b22e71183669755c
I20260808 08:46:37.976780 21071 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: loading cluster ID for follower catalog manager: success
I20260808 08:46:37.984781 21071 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: acquiring CA information for follower catalog manager: success
I20260808 08:46:38.003553 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:37.971009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53314 (local address 127.19.242.253:43109)
0808 08:46:37.971419 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:37.971437 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:37.987797 (+ 16360us) server_negotiation.cc:407] Connection header received
0808 08:46:37.988465 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:37.988472 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:37.988803 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:37.988993 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:37.990795 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.992759 (+ 1964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.996702 (+ 3943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:37.998173 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:37.998420 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:38.000188 (+ 1768us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:38.001767 (+ 1579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:38.002032 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:38.002637 (+ 605us) server_negotiation.cc:299] Negotiation successful
0808 08:46:38.002879 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260808 08:46:38.004037 21071 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 31f22e93db43438cbc9b43c8fd6345af: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:46:38.102120 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:38.058915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48980 (local address 127.19.242.252:37935)
0808 08:46:38.059309 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:38.059329 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:38.069433 (+ 10104us) server_negotiation.cc:407] Connection header received
0808 08:46:38.069976 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:38.069987 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:38.070331 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:38.070646 (+ 315us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:38.083038 (+ 12392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.085426 (+ 2388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.090615 (+ 5189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.091883 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.092125 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:38.098880 (+ 6755us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:38.100211 (+ 1331us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:38.100564 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:38.101223 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 08:46:38.101452 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:46:38.237830 21031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:38.155649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.19.242.253:43109)
0808 08:46:38.156122 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:38.156143 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:38.183284 (+ 27141us) server_negotiation.cc:407] Connection header received
0808 08:46:38.189893 (+ 6609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:38.189917 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:38.190274 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:38.190534 (+ 260us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:38.199382 (+ 8848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.201898 (+ 2516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.224315 (+ 22417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.225960 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.226304 (+ 344us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:38.232815 (+ 6511us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:38.233311 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:38.233582 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:38.236805 (+ 3223us) server_negotiation.cc:299] Negotiation successful
0808 08:46:38.237037 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186}
I20260808 08:46:38.247946 21142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:38.162088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56748 (local address 127.19.242.254:42439)
0808 08:46:38.162510 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:38.162529 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:38.188153 (+ 25624us) server_negotiation.cc:407] Connection header received
0808 08:46:38.194345 (+ 6192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:38.194352 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:38.194939 (+ 587us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:38.195324 (+ 385us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:38.207559 (+ 12235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.210222 (+ 2663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.230299 (+ 20077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.231835 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.232234 (+ 399us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:38.243322 (+ 11088us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:38.244466 (+ 1144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:38.244716 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:38.246858 (+ 2142us) server_negotiation.cc:299] Negotiation successful
0808 08:46:38.247084 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260808 08:46:38.250192 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:38.166516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48996 (local address 127.19.242.252:37935)
0808 08:46:38.166961 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:38.166982 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:38.193157 (+ 26175us) server_negotiation.cc:407] Connection header received
0808 08:46:38.195830 (+ 2673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:38.195841 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:38.196051 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:38.196204 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:38.212323 (+ 16119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.215078 (+ 2755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.227991 (+ 12913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:38.229594 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:38.229893 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:38.245577 (+ 15684us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:38.245937 (+ 360us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:38.246153 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:38.249207 (+ 3054us) server_negotiation.cc:299] Negotiation successful
0808 08:46:38.249490 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196}
I20260808 08:46:38.264495 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20721
I20260808 08:46:38.271490 20811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:38.435774 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20721
W20260808 08:46:38.482957 20847 connection.cc:535] server connection from 127.0.0.1:53234 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:46:38.483655 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20825
I20260808 08:46:38.485651 20913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:38.645884 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20825
I20260808 08:46:38.706897 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 20928
I20260808 08:46:38.708873 21013 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:38.862505 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 20928
2026-08-08T08:46:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5696 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:46:39 dist-test-slave-39l8 krb5kdc[21195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:46:39 dist-test-slave-39l8 krb5kdc[21195](info): set up 2 sockets
Aug 08 08:46:39 dist-test-slave-39l8 krb5kdc[21195](info): commencing operation
krb5kdc: starting...
W20260808 08:46:40.383112 20427 mini_kdc.cc:121] Time spent starting KDC: real 1.437s user 0.010s sys 0.089s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/test-user.keytab.
Aug 08 08:46:40 dist-test-slave-39l8 krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:46:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:46:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.242.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
Entry for principal kudu/127.19.242.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab.
I20260808 08:46:40.762398 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42131
--webserver_interface=127.19.242.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42131,127.19.242.253:40577,127.19.242.252:43425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:46:41.132249 21219 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:46:41.132663 21219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:41.132802 21219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:41.132931 21219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:41.140704 21219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:41.140825 21219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:41.140911 21219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:41.140993 21219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:41.141076 21219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:41.151573 21219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42131,127.19.242.253:40577,127.19.242.252:43425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.254.keytab
--principal=kudu/127.19.242.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.254:42131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.242.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:41.153364 21219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:41.154985 21219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:41.167863 21230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:41.167914 21228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:41.167836 21227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:41.169009 21219 server_base.cc:1034] running on GCE node
I20260808 08:46:41.169945 21219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:41.171612 21219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:41.172924 21219 hybrid_clock.cc:648] HybridClock initialized: now 1786178801172845 us; error 44 us; skew 500 ppm
I20260808 08:46:41.173342 21219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:41 dist-test-slave-39l8 krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:41.181836 21219 init.cc:377] Logged in from keytab as kudu/127.19.242.254@KRBTEST.COM (short username kudu)
I20260808 08:46:41.183945 21219 webserver.cc:460] Webserver started at http://127.19.242.254:38177/ using document root <none> and password file <none>
I20260808 08:46:41.184860 21219 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:41.185024 21219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:41.185427 21219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:41.189209 21219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data/instance:
uuid: "a3a86927c55e4532821eb4410588d05e"
format_stamp: "Formatted at 2026-08-08 08:46:41 on dist-test-slave-39l8"
server_key: "d66b529ede8a09f2df08a0842820eb4f"
server_key_iv: "5e5218eae385299d5e46021d7a2e139c"
server_key_version: "encryptionkey@0"
I20260808 08:46:41.190234 21219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/wal/instance:
uuid: "a3a86927c55e4532821eb4410588d05e"
format_stamp: "Formatted at 2026-08-08 08:46:41 on dist-test-slave-39l8"
server_key: "d66b529ede8a09f2df08a0842820eb4f"
server_key_iv: "5e5218eae385299d5e46021d7a2e139c"
server_key_version: "encryptionkey@0"
I20260808 08:46:41.196949 21219 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260808 08:46:41.201848 21243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:41.203876 21219 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:46:41.204146 21219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/wal
uuid: "a3a86927c55e4532821eb4410588d05e"
format_stamp: "Formatted at 2026-08-08 08:46:41 on dist-test-slave-39l8"
server_key: "d66b529ede8a09f2df08a0842820eb4f"
server_key_iv: "5e5218eae385299d5e46021d7a2e139c"
server_key_version: "encryptionkey@0"
I20260808 08:46:41.204430 21219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:41.224730 21219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:41.229784 21219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:41.230176 21219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:41.252622 21219 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.254:42131
I20260808 08:46:41.252646 21313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.254:42131 every 8 connection(s)
I20260808 08:46:41.254349 21219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/data/info.pb
I20260808 08:46:41.259196 21314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:41.261826 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21219
I20260808 08:46:41.262056 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-0/wal/instance
I20260808 08:46:41.262630 20427 external_mini_cluster.cc:1428] Setting key fc4178b4f4a023d8f5228aae020ac165
I20260808 08:46:41.270352 21314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:41 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:41.299352 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.276522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52120 (local address 127.19.242.254:42131)
0808 08:46:41.277468 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:41.277479 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:41.277550 (+ 71us) server_negotiation.cc:407] Connection header received
0808 08:46:41.279103 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:41.279115 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:41.279515 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:41.279804 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:41.281959 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.283377 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.285851 (+ 2474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.286465 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.286615 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.291279 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:41.291288 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:41.291303 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:41.291340 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:41.294374 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.295262 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.295270 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.295272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.295427 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.295845 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.295850 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.295858 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.296500 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:41.296731 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:41.297334 (+ 603us) server_negotiation.cc:299] Negotiation successful
0808 08:46:41.297752 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":690,"thread_start_us":500,"threads_started":1}
I20260808 08:46:41.299372 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.275000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42131 (local address 127.0.0.1:52120)
0808 08:46:41.275980 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.276044 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:41.278519 (+ 2475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:41.279991 (+ 1472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:41.280001 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:41.281059 (+ 1058us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:41.281656 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.281691 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.283565 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.283574 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.285601 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.285631 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.286768 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.286779 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.287055 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.287880 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:41.287923 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:41.291014 (+ 3091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:41.294551 (+ 3537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.294566 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.294580 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.295104 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.295546 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.295552 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.295555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.295728 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.296642 (+ 914us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:41.296651 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:41.296890 (+ 239us) client_negotiation.cc:769] Sending connection context
0808 08:46:41.297181 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 08:46:41.297880 (+ 699us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":172,"thread_start_us":452,"threads_started":1}
WARNING: no policy specified for kudu/127.19.242.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.253@KRBTEST.COM" created.
I20260808 08:46:41.303465 21314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:46:41.305035 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.304441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:50958)
0808 08:46:41.304683 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.304848 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260808 08:46:41.305495 21247 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
I20260808 08:46:41.307456 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.306924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:50974)
0808 08:46:41.307151 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.307257 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:46:41.307709 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:40577: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab.
Entry for principal kudu/127.19.242.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab.
I20260808 08:46:41.344450 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:40577
--webserver_interface=127.19.242.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab
--principal=kudu/127.19.242.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42131,127.19.242.253:40577,127.19.242.252:43425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:46:41.357160 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } attempt: 1
I20260808 08:46:41.358690 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.358043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:50976)
0808 08:46:41.358309 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.358483 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 08:46:41.359829 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.359435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:50982)
0808 08:46:41.359608 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.359688 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:46:41.360064 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:40577: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
I20260808 08:46:41.428332 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } attempt: 2
I20260808 08:46:41.429728 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.429079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:50984)
0808 08:46:41.429397 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.429535 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 08:46:41.430913 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.430437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:50996)
0808 08:46:41.430594 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.430734 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:46:41.431123 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:40577: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
I20260808 08:46:41.522459 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } attempt: 3
I20260808 08:46:41.523969 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.523332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:51000)
0808 08:46:41.523619 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.523764 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 08:46:41.525288 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.524824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:51016)
0808 08:46:41.525000 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.525096 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:46:41.525544 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:40577: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
I20260808 08:46:41.668838 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } attempt: 4
I20260808 08:46:41.670264 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.669574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:51022)
0808 08:46:41.669939 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.670066 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184}
I20260808 08:46:41.671563 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.671046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:51028)
0808 08:46:41.671239 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.671367 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:46:41.671868 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.253:40577: Network error: Client connection negotiation failed: client connection to 127.19.242.253:40577: connect: Connection refused (error 111)
W20260808 08:46:41.725595 21323 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:46:41.726043 21323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:41.726166 21323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:41.726284 21323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:41.735496 21323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:41.735613 21323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:41.735720 21323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:41.735808 21323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:41.735924 21323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:41.747682 21323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42131,127.19.242.253:40577,127.19.242.252:43425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.253.keytab
--principal=kudu/127.19.242.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.253:40577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.242.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:41.749138 21323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:41.750545 21323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:41.763430 21333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:41.763520 21335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:41.763474 21338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:41.764781 21323 server_base.cc:1034] running on GCE node
I20260808 08:46:41.765713 21323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:41.767351 21323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:41.768622 21323 hybrid_clock.cc:648] HybridClock initialized: now 1786178801768542 us; error 41 us; skew 500 ppm
I20260808 08:46:41.769035 21323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:41 dist-test-slave-39l8 krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:41.772605 21323 init.cc:377] Logged in from keytab as kudu/127.19.242.253@KRBTEST.COM (short username kudu)
I20260808 08:46:41.774297 21323 webserver.cc:460] Webserver started at http://127.19.242.253:34177/ using document root <none> and password file <none>
I20260808 08:46:41.775180 21323 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:41.775303 21323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:41.775674 21323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:41.778940 21323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data/instance:
uuid: "6fd0d7f9b24141849b0721f51ceb70a7"
format_stamp: "Formatted at 2026-08-08 08:46:41 on dist-test-slave-39l8"
server_key: "af5575ced178d87496dc82c14bc899bd"
server_key_iv: "b7be737eca728bfd5b426b04b499c049"
server_key_version: "encryptionkey@0"
I20260808 08:46:41.779834 21323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/wal/instance:
uuid: "6fd0d7f9b24141849b0721f51ceb70a7"
format_stamp: "Formatted at 2026-08-08 08:46:41 on dist-test-slave-39l8"
server_key: "af5575ced178d87496dc82c14bc899bd"
server_key_iv: "b7be737eca728bfd5b426b04b499c049"
server_key_version: "encryptionkey@0"
I20260808 08:46:41.785661 21323 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:46:41.789718 21348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:41.791343 21323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:46:41.791548 21323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/wal
uuid: "6fd0d7f9b24141849b0721f51ceb70a7"
format_stamp: "Formatted at 2026-08-08 08:46:41 on dist-test-slave-39l8"
server_key: "af5575ced178d87496dc82c14bc899bd"
server_key_iv: "b7be737eca728bfd5b426b04b499c049"
server_key_version: "encryptionkey@0"
I20260808 08:46:41.791814 21323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:41.806958 21323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:41.812022 21323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:41.812347 21323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:41.832793 21323 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.253:40577
I20260808 08:46:41.832811 21418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.253:40577 every 8 connection(s)
I20260808 08:46:41.834378 21323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/data/info.pb
I20260808 08:46:41.838378 21419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:41.844053 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21323
I20260808 08:46:41.844283 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-1/wal/instance
I20260808 08:46:41.844861 20427 external_mini_cluster.cc:1428] Setting key 857f5fe4fb52f25ebcf6a8eb61e2b397
I20260808 08:46:41.846385 21419 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:41 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:41.875208 21423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.850198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59176 (local address 127.19.242.254:42131)
0808 08:46:41.850841 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:41.850851 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:41.852088 (+ 1237us) server_negotiation.cc:407] Connection header received
0808 08:46:41.855300 (+ 3212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:41.855305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:41.855388 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:41.855505 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:41.857988 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.859087 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.861834 (+ 2747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.862738 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.862926 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.867702 (+ 4776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:41.867709 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:41.867713 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:41.867771 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:41.870928 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.872183 (+ 1255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.872188 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.872190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.872321 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.872955 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.872958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.872960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.873294 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:41.873405 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:41.874622 (+ 1217us) server_negotiation.cc:299] Negotiation successful
0808 08:46:41.874883 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":296,"threads_started":1}
I20260808 08:46:41.876981 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.850940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42131 (local address 127.0.0.1:59176)
0808 08:46:41.851835 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.851905 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:41.854867 (+ 2962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:41.855834 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:41.855849 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:41.856772 (+ 923us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:41.857677 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.857708 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.859345 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.859353 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.861615 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.861632 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.862992 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.862998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.863242 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.863999 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:41.864031 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:41.867327 (+ 3296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:41.871138 (+ 3811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.871153 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.871179 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.872031 (+ 852us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.872469 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.872479 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.872485 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.872832 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.873452 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:41.873465 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:41.874057 (+ 592us) client_negotiation.cc:769] Sending connection context
0808 08:46:41.874534 (+ 477us) client_negotiation.cc:240] Negotiation successful
0808 08:46:41.875238 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":330,"threads_started":1}
I20260808 08:46:41.879230 21419 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.242.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.242.252@KRBTEST.COM" created.
Aug 08 08:46:41 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:46:41.897640 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.880236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:51032)
0808 08:46:41.880452 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.880480 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:41.880639 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:41.881787 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:41.881790 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:41.882226 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:41.882476 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.882487 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.885082 (+ 2595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.885087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.886151 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.886170 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.887444 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.887454 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.887633 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.888291 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:41.888322 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:41.891008 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:41.894823 (+ 3815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.894829 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.894834 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.895301 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.895752 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.895762 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.895764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.895894 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.896620 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:41.896625 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:41.896772 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 08:46:41.896911 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 08:46:41.897215 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 08:46:41.897734 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.880365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51032 (local address 127.19.242.253:40577)
0808 08:46:41.881129 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:41.881143 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:41.881183 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:46:41.881271 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:41.881284 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:41.881594 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:41.881793 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:41.882691 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.884863 (+ 2172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.886365 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.887232 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.887413 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.891274 (+ 3861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:41.891292 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:41.891311 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:41.891352 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:41.894586 (+ 3234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.895447 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.895462 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.895465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.895612 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.896001 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.896008 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.896011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.896475 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:41.896697 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:41.897100 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 08:46:41.897335 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":361,"threads_started":1}
I20260808 08:46:41.900483 21419 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:46:41.901862 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.901371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43608)
0808 08:46:41.901565 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.901689 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 08:46:41.902201 21353 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:41.903965 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.903564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43618)
0808 08:46:41.903757 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.903840 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:46:41.904246 21419 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.242.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab.
Entry for principal kudu/127.19.242.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab.
I20260808 08:46:41.932395 20427 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
/tmp/dist-test-taskkvSB7S/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:43425
--webserver_interface=127.19.242.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab
--principal=kudu/127.19.242.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.242.212:43079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.242.254:42131,127.19.242.253:40577,127.19.242.252:43425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:46:41.953644 21419 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 1
I20260808 08:46:41.955090 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.954404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43626)
0808 08:46:41.954688 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.954865 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 08:46:41.956467 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.955954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43632)
0808 08:46:41.956177 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.956303 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:46:41.956769 21419 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:41.971166 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } attempt: 5
Aug 08 08:46:41 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:46:41.988679 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.972112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:51046)
0808 08:46:41.972382 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.972405 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:41.972556 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:41.972976 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:41.972981 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:41.973514 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:41.973767 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.973783 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.975327 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.975334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.976760 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:41.976780 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.977693 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.977700 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:41.977929 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.978697 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:41.978746 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:41.981495 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:41.985931 (+ 4436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.985937 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.985940 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.986417 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.986926 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:41.986931 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:41.986933 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:41.987108 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:41.987832 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:41.987837 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:41.987990 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 08:46:41.988135 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 08:46:41.988408 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 08:46:41.988854 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.972205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51046 (local address 127.19.242.253:40577)
0808 08:46:41.972416 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:41.972421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:41.972472 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:46:41.972708 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:41.972712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:41.972808 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:41.972911 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:41.973981 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.975131 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.976967 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:41.977494 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:41.977619 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:41.981794 (+ 4175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:41.981802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:41.981807 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:41.981861 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:41.985691 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.986572 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.986578 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.986581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.986785 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:41.987244 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:41.987248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:41.987252 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:41.987651 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:41.987808 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:41.988292 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 08:46:41.988543 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:46:41.990074 21314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:46:41.991348 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.990938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43636)
0808 08:46:41.991116 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.991203 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 08:46:41.992599 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:41.992158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43650)
0808 08:46:41.992383 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:41.992484 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260808 08:46:41.992846 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:42.025027 21419 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 2
I20260808 08:46:42.026312 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.025800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43660)
0808 08:46:42.026016 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.026118 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 08:46:42.027558 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.027106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43670)
0808 08:46:42.027330 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.027423 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:46:42.027897 21419 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:42.044096 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 1
I20260808 08:46:42.045527 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.044959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43672)
0808 08:46:42.045238 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.045336 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260808 08:46:42.046787 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.046396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43684)
0808 08:46:42.046544 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.046621 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:46:42.047106 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:42.115350 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 2
I20260808 08:46:42.116703 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.116164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43694)
0808 08:46:42.116423 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.116518 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 08:46:42.117864 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.117463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43698)
0808 08:46:42.117665 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.117754 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 08:46:42.118173 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:42.119135 21419 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 3
I20260808 08:46:42.120240 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.119756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43710)
0808 08:46:42.119971 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.120060 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 08:46:42.121426 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.120910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43714)
0808 08:46:42.121145 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.121263 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
W20260808 08:46:42.121826 21419 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:42.224452 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 3
I20260808 08:46:42.225840 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.225303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43718)
0808 08:46:42.225540 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.225648 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 08:46:42.227074 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.226637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43726)
0808 08:46:42.226877 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.226954 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260808 08:46:42.227382 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:42.265100 21419 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 4
I20260808 08:46:42.266561 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.265910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43736)
0808 08:46:42.266264 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.266366 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 08:46:42.267843 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.267417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43742)
0808 08:46:42.267620 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.267711 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:46:42.268174 21419 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
W20260808 08:46:42.319221 21433 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:46:42.319656 21433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:46:42.319962 21433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:46:42.320163 21433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:46:42.328258 21433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:46:42.328375 21433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:46:42.328469 21433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:46:42.328547 21433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:46:42.328641 21433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:46:42.339476 21433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.242.212:43079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.242.254:42131,127.19.242.253:40577,127.19.242.252:43425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/krb5kdc/kudu_127.19.242.252.keytab
--principal=kudu/127.19.242.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.242.252:43425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.242.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:46:42.340936 21433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:46:42.342393 21433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:46:42.355484 21441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:42.355422 21444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:46:42.356093 21440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:46:42.356662 21433 server_base.cc:1034] running on GCE node
I20260808 08:46:42.357661 21433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:46:42.359455 21433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:46:42.360739 21433 hybrid_clock.cc:648] HybridClock initialized: now 1786178802360669 us; error 47 us; skew 500 ppm
I20260808 08:46:42.361162 21433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:46:42.364890 21433 init.cc:377] Logged in from keytab as kudu/127.19.242.252@KRBTEST.COM (short username kudu)
I20260808 08:46:42.366567 21433 webserver.cc:460] Webserver started at http://127.19.242.252:40077/ using document root <none> and password file <none>
I20260808 08:46:42.367429 21433 fs_manager.cc:359] Metadata directory not provided
I20260808 08:46:42.367594 21433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:46:42.367918 21433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:46:42.371384 21433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data/instance:
uuid: "409f3e03f32045c486518c6f7ca73798"
format_stamp: "Formatted at 2026-08-08 08:46:42 on dist-test-slave-39l8"
server_key: "b99451974d65e56e903fc2fe259f716c"
server_key_iv: "c0265d6a3374530f7d28b7bd45c7469c"
server_key_version: "encryptionkey@0"
I20260808 08:46:42.372340 21433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/wal/instance:
uuid: "409f3e03f32045c486518c6f7ca73798"
format_stamp: "Formatted at 2026-08-08 08:46:42 on dist-test-slave-39l8"
server_key: "b99451974d65e56e903fc2fe259f716c"
server_key_iv: "c0265d6a3374530f7d28b7bd45c7469c"
server_key_version: "encryptionkey@0"
I20260808 08:46:42.378677 21433 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260808 08:46:42.383049 21453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:46:42.384680 21433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:46:42.384908 21433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data,/tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/wal
uuid: "409f3e03f32045c486518c6f7ca73798"
format_stamp: "Formatted at 2026-08-08 08:46:42 on dist-test-slave-39l8"
server_key: "b99451974d65e56e903fc2fe259f716c"
server_key_iv: "c0265d6a3374530f7d28b7bd45c7469c"
server_key_version: "encryptionkey@0"
I20260808 08:46:42.385190 21433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:46:42.404632 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 4
I20260808 08:46:42.405937 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.405394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43746)
0808 08:46:42.405626 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.405738 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 08:46:42.407366 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.406919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43756)
0808 08:46:42.407103 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.407200 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:46:42.407647 21314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.242.252:43425: Network error: Client connection negotiation failed: client connection to 127.19.242.252:43425: connect: Connection refused (error 111)
I20260808 08:46:42.408154 21433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:46:42.413316 21433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:46:42.413635 21433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:46:42.434232 21433 rpc_server.cc:307] RPC server started. Bound to: 127.19.242.252:43425
I20260808 08:46:42.434289 21526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.242.252:43425 every 8 connection(s)
I20260808 08:46:42.435834 21433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/data/info.pb
I20260808 08:46:42.440176 21527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:46:42.442204 20427 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu as pid 21433
I20260808 08:46:42.442396 20427 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskkvSB7S/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178398071314-20427-0/minicluster-data/master-2/wal/instance
I20260808 08:46:42.442945 20427 external_mini_cluster.cc:1428] Setting key 93be7bbd674fcf44ba15e8d40fb55b46
I20260808 08:46:42.450484 21527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:42.470841 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.444840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43762 (local address 127.19.242.252:43425)
0808 08:46:42.445723 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.445736 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.445783 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:46:42.447472 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.447498 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.447955 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.448312 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.450507 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.452246 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.454067 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.455401 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.455616 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.461067 (+ 5451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.461080 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.461100 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.461157 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.465981 (+ 4824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.466993 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.467002 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.467010 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.467204 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.467656 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.467662 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.467665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.468277 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.468610 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.469113 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.469635 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":407,"threads_started":1}
I20260808 08:46:42.474086 21533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.453669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.19.242.254:42131)
0808 08:46:42.455252 (+ 1583us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.455257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.455273 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:46:42.455330 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.455334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.455413 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.455567 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.456875 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.458218 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.459946 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.460703 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.460866 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.466442 (+ 5576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.466452 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.466460 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.466527 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.469745 (+ 3218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.470596 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.470600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.470603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.470815 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.471253 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.471258 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.471262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.471559 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.471740 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.473319 (+ 1579us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.473589 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1470,"thread_start_us":1338,"threads_started":1}
I20260808 08:46:42.474473 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.453603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.254:42131 (local address 127.0.0.1:59178)
0808 08:46:42.454485 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.454536 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:42.454774 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:42.455675 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:42.455682 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:42.456413 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:42.456680 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.456692 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.458445 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.458450 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.459753 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.459771 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.461067 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.461077 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.461325 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.462166 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:42.462240 (+ 74us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:42.466082 (+ 3842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:42.469908 (+ 3826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.469925 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.469933 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.470436 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.470942 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.470947 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.470952 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.471130 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.471715 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:42.471724 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:42.471931 (+ 207us) client_negotiation.cc:769] Sending connection context
0808 08:46:42.473159 (+ 1228us) client_negotiation.cc:240] Negotiation successful
0808 08:46:42.473987 (+ 828us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"spinlock_wait_cycles":28928,"thread_start_us":369,"threads_started":1}
I20260808 08:46:42.476305 21527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.254@KRBTEST.COM
I20260808 08:46:42.492225 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.477462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.253:40577 (local address 127.0.0.1:51060)
0808 08:46:42.477722 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.477752 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:42.477938 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:42.478406 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:42.478413 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:42.479170 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:42.479442 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.479454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.480580 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.480587 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.481591 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.481606 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.482384 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.482391 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.482598 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.483305 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:42.483324 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:42.485787 (+ 2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:42.489469 (+ 3682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.489475 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.489480 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.489928 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.490403 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.490408 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.490412 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.490583 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.491167 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:42.491172 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:42.491339 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 08:46:42.491485 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 08:46:42.491832 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 08:46:42.492255 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.477577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51060 (local address 127.19.242.253:40577)
0808 08:46:42.477766 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.477771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.477882 (+ 111us) server_negotiation.cc:407] Connection header received
0808 08:46:42.478169 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.478173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.478244 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.478337 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.479685 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.480415 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.481769 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.482221 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.482368 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.486030 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.486040 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.486047 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.486102 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.489301 (+ 3199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.490062 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.490077 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.490079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.490272 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.490718 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.490727 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.490730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.491026 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.491208 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.491600 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.491832 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:46:42.493381 21527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:46:42.494477 21533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.474433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59184 (local address 127.19.242.254:42131)
0808 08:46:42.475128 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.475133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.479052 (+ 3919us) server_negotiation.cc:407] Connection header received
0808 08:46:42.479320 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.479329 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.479456 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.480891 (+ 1435us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.481013 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.481660 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.483043 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.483569 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.483715 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.488517 (+ 4802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.488523 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.488526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.488563 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.491547 (+ 2984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.492281 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.492288 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.492291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.492473 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.492921 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.492927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.492930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.493219 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.493522 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.493874 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.494119 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":4938,"threads_started":1}
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178802, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.252@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.242.253@KRBTEST.COM
I20260808 08:46:42.510535 21532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.494220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43774)
0808 08:46:42.494391 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.494412 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:42.494678 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:42.495174 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:42.495180 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:42.495744 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:42.495972 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.495984 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.497214 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.497218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.498687 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.498733 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.499591 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.499596 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.499877 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.500499 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:42.500524 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:42.503480 (+ 2956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:42.507491 (+ 4011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.507496 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.507499 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.507908 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.508476 (+ 568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.508482 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.508485 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.508620 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.509312 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:42.509316 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:42.509468 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 08:46:42.509630 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 08:46:42.509965 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":60}
I20260808 08:46:42.510747 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.494452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43774 (local address 127.19.242.252:43425)
0808 08:46:42.494583 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.494590 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.494610 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:46:42.494866 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.494874 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.494961 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.495070 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.496113 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.497095 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.498867 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.499433 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.499580 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.503684 (+ 4104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.503696 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.503700 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.503731 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.507300 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.508163 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.508169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.508173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.508362 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.508754 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.508758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.508762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.509157 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.509333 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.509785 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.510282 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":133,"server-negotiator.queue_time_us":33}
I20260808 08:46:42.514921 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.496735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51068 (local address 127.19.242.253:40577)
0808 08:46:42.496915 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.496920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.496974 (+ 54us) server_negotiation.cc:407] Connection header received
0808 08:46:42.497132 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.497140 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.497237 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.497323 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.499109 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.500129 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.502068 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.502863 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.503004 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.508117 (+ 5113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.508124 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.508128 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.508169 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.511669 (+ 3500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.512632 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.512636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.512638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.512799 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.513315 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.513320 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.513322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.513665 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.513940 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.514331 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.514538 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:46:42.517114 21527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: Bootstrap starting.
I20260808 08:46:42.520824 20427 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:46:42.521183 21527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:42.522370 21527 log.cc:824] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:42.526250 21527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: No bootstrap required, opened a new log
I20260808 08:46:42.523753 21281 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a3a86927c55e4532821eb4410588d05e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59184
I20260808 08:46:42.537994 21527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.538480 21527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 409f3e03f32045c486518c6f7ca73798, State: Initialized, Role: FOLLOWER
I20260808 08:46:42.539095 21527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.540211 21536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.540620 21536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:42.541574 21527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:46:42.552861 21549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:46:42.553066 21549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:46:42.550304 21433 master_runner.cc:186] Error getting master registration for 127.19.242.254:42131: OK, instance_id { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" instance_seqno: 1786178801246281 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:46:42.562439 21433 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:46:42.567436 21419 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 5
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.253@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
I20260808 08:46:42.586333 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.568356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43786 (local address 127.19.242.252:43425)
0808 08:46:42.568577 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.568583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.568608 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:46:42.568796 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.568801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.568891 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.569023 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.570117 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.571348 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.573404 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.574213 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.574354 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.578563 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.578571 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.578577 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.578627 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.582776 (+ 4149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.583787 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.583794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.583798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.583969 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.584492 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.584499 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.584503 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.585015 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.585211 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.585691 (+ 480us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.585943 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:46:42.586349 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.568274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43786)
0808 08:46:42.568496 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.568520 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:42.568655 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:42.569086 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:42.569091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:42.569691 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:42.569937 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.569950 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.571525 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.571531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.573211 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.573234 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.574409 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.574417 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.574688 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.575564 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:42.575585 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:42.578287 (+ 2702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:42.582973 (+ 4686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.582980 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.582986 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.583624 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.584119 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.584126 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.584132 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.584359 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.585152 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:42.585157 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:42.585357 (+ 200us) client_negotiation.cc:769] Sending connection context
0808 08:46:42.585530 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 08:46:42.585889 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 08:46:42.592268 21419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: Bootstrap starting.
I20260808 08:46:42.596076 21419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:42.597391 21419 log.cc:824] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:42.600638 21419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: No bootstrap required, opened a new log
I20260808 08:46:42.609931 21419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.610435 21419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd0d7f9b24141849b0721f51ceb70a7, State: Initialized, Role: FOLLOWER
I20260808 08:46:42.611007 21419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.612069 21552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.612507 21552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:42.613401 21419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:46:42.625669 21574 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:46:42.625973 21574 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:46:42.621932 21323 master_runner.cc:186] Error getting master registration for 127.19.242.254:42131: OK, instance_id { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" instance_seqno: 1786178801246281 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:46:42.634891 21323 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 08:46:42.666342 21459 tablet.cc:2369] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:46:42.684921 21314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } attempt: 5
Aug 08 08:46:42 dist-test-slave-39l8 krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178801, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.242.254@KRBTEST.COM for kudu/127.19.242.252@KRBTEST.COM
I20260808 08:46:42.705354 21317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.685821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.242.252:43425 (local address 127.0.0.1:43790)
0808 08:46:42.686169 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 08:46:42.686193 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:46:42.686339 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:46:42.687024 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:46:42.687029 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:46:42.687618 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:46:42.687855 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.687869 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.689585 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.689598 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.691234 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:46:42.691267 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.692464 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.692472 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:46:42.692695 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.693495 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:46:42.693522 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:46:42.696559 (+ 3037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:46:42.701875 (+ 5316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.701883 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.701888 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.702551 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.703120 (+ 569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:46:42.703127 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:46:42.703131 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:46:42.703346 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:46:42.704096 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:46:42.704102 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:46:42.704314 (+ 212us) client_negotiation.cc:769] Sending connection context
0808 08:46:42.704501 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 08:46:42.704860 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189}
I20260808 08:46:42.705344 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.685919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43790 (local address 127.19.242.252:43425)
0808 08:46:42.686606 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.686613 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.686637 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:46:42.686738 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.686747 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.686844 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.686964 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.688076 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.689419 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.691426 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.692259 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.692418 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.696842 (+ 4424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.696856 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.696862 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.696911 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.701629 (+ 4718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.702745 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.702752 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.702757 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.702969 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.703514 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.703522 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.703525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.703925 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.704084 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.704632 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.704914 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538}
I20260808 08:46:42.713165 21314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e: Bootstrap starting.
I20260808 08:46:42.718345 21314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e: Neither blocks nor log segments found. Creating new log.
I20260808 08:46:42.720041 21314 log.cc:824] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:46:42.724496 21314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e: No bootstrap required, opened a new log
I20260808 08:46:42.733978 21314 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.734611 21314 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3a86927c55e4532821eb4410588d05e, State: Initialized, Role: FOLLOWER
I20260808 08:46:42.735349 21314 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.736909 21578 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.737663 21578 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:42.738376 21314 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:46:42.738454 21281 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:46:42.738691 21281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:42.742599 21281 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.746316 21381 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3a86927c55e4532821eb4410588d05e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6fd0d7f9b24141849b0721f51ceb70a7"
I20260808 08:46:42.746938 21381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:42.750923 21381 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3a86927c55e4532821eb4410588d05e in term 1.
I20260808 08:46:42.751806 21247 leader_election.cc:302] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fd0d7f9b24141849b0721f51ceb70a7, a3a86927c55e4532821eb4410588d05e; no voters:
I20260808 08:46:42.753715 21489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3a86927c55e4532821eb4410588d05e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "409f3e03f32045c486518c6f7ca73798"
I20260808 08:46:42.754293 21489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:46:42.758181 21489 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3a86927c55e4532821eb4410588d05e in term 1.
I20260808 08:46:42.759584 21281 leader_election.cc:288] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [CANDIDATE]: Term 1 election: Requested vote from peers 6fd0d7f9b24141849b0721f51ceb70a7 (127.19.242.253:40577), 409f3e03f32045c486518c6f7ca73798 (127.19.242.252:43425)
I20260808 08:46:42.766822 21578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:46:42.775118 21578 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [term 1 LEADER]: Becoming Leader. State: Replica: a3a86927c55e4532821eb4410588d05e, State: Running, Role: LEADER
I20260808 08:46:42.776330 21578 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } }
I20260808 08:46:42.788360 21585 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3a86927c55e4532821eb4410588d05e. Latest consensus state: current_term: 1 leader_uuid: "a3a86927c55e4532821eb4410588d05e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.789072 21585 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:42.804199 21595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260808 08:46:42.815250 21355 tablet.cc:2369] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:46:42.827702 21595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:46:42.844470 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.785395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51076 (local address 127.19.242.253:40577)
0808 08:46:42.785612 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.785619 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.792165 (+ 6546us) server_negotiation.cc:407] Connection header received
0808 08:46:42.794401 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.794407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.794499 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.794586 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.800379 (+ 5793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.801591 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.807361 (+ 5770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.808130 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.808264 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.823008 (+ 14744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.823016 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.823022 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.823082 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.827157 (+ 4075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.829321 (+ 2164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.829330 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.829334 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.829527 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.830032 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.830038 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.830042 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.830470 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.830785 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.843671 (+ 12886us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.844057 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:46:42.848171 21531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.787492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43806 (local address 127.19.242.252:43425)
0808 08:46:42.787740 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.787749 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.804769 (+ 17020us) server_negotiation.cc:407] Connection header received
0808 08:46:42.805315 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.805323 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.805427 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.805511 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.808140 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.809249 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.813537 (+ 4288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.814429 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.814581 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.838867 (+ 24286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.838898 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.838912 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.838998 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.843998 (+ 5000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.845029 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.845037 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.845040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.845220 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.845742 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.845746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.845749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.846181 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.847347 (+ 1166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.847493 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.847775 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:46:42.851454 21533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:42.785830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59186 (local address 127.19.242.254:42131)
0808 08:46:42.786012 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:42.786019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:42.790971 (+ 4952us) server_negotiation.cc:407] Connection header received
0808 08:46:42.795732 (+ 4761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:42.795742 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:42.795864 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:42.795965 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:42.803813 (+ 7848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.805114 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.808987 (+ 3873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:42.809818 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:42.809952 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:42.817456 (+ 7504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:46:42.817465 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:46:42.817471 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:46:42.817543 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:46:42.821748 (+ 4205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.828380 (+ 6632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.828388 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.828393 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.828631 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:46:42.831362 (+ 2731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:46:42.831369 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:46:42.831373 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:46:42.831820 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:46:42.839126 (+ 7306us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:42.850474 (+ 11348us) server_negotiation.cc:299] Negotiation successful
0808 08:46:42.850807 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:46:42.851547 21611 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:46:42.860344 21489 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [term 1 FOLLOWER]: Refusing update from remote peer a3a86927c55e4532821eb4410588d05e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:46:42.861783 21585 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [LEADER]: Connected to new peer: Peer: permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:46:42.863957 21381 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [term 1 FOLLOWER]: Refusing update from remote peer a3a86927c55e4532821eb4410588d05e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:46:42.864969 21585 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:46:42.914721 21536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3a86927c55e4532821eb4410588d05e. Latest consensus state: current_term: 1 leader_uuid: "a3a86927c55e4532821eb4410588d05e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.915123 21536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:42.915390 21612 mvcc.cc:205] Tried to move back new op lower bound from 7316188376495570944 to 7316188376191746048. Current Snapshot: MvccSnapshot[applied={T|T < 7316188376495570944}]
I20260808 08:46:42.917392 21595 catalog_manager.cc:1347] Generated new cluster ID: fe3fa549f43344c29e7a9185d8a38acf
I20260808 08:46:42.917536 21595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:46:42.918128 21585 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3a86927c55e4532821eb4410588d05e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.918423 21585 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:42.918896 21613 mvcc.cc:205] Tried to move back new op lower bound from 7316188376495570944 to 7316188376191746048. Current Snapshot: MvccSnapshot[applied={T|T < 7316188376495570944}]
I20260808 08:46:42.919647 21536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3a86927c55e4532821eb4410588d05e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.919926 21536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:42.926545 21552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3a86927c55e4532821eb4410588d05e. Latest consensus state: current_term: 1 leader_uuid: "a3a86927c55e4532821eb4410588d05e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.926991 21552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:42.941413 21585 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3a86927c55e4532821eb4410588d05e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.941769 21585 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e [sys.catalog]: This master's current role is: LEADER
I20260808 08:46:42.944629 21615 mvcc.cc:205] Tried to move back new op lower bound from 7316188376495570944 to 7316188376191746048. Current Snapshot: MvccSnapshot[applied={T|T < 7316188376495570944}]
I20260808 08:46:42.951784 21595 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:46:42.952580 21552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3a86927c55e4532821eb4410588d05e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3a86927c55e4532821eb4410588d05e" member_type: VOTER last_known_addr { host: "127.19.242.254" port: 42131 } } peers { permanent_uuid: "6fd0d7f9b24141849b0721f51ceb70a7" member_type: VOTER last_known_addr { host: "127.19.242.253" port: 40577 } } peers { permanent_uuid: "409f3e03f32045c486518c6f7ca73798" member_type: VOTER last_known_addr { host: "127.19.242.252" port: 43425 } } }
I20260808 08:46:42.952877 21552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:46:42.958736 21595 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:46:43.004806 21595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3a86927c55e4532821eb4410588d05e: Generated new TSK 0
I20260808 08:46:43.006255 21595 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:46:43.185967 21533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.155744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.19.242.254:42131)
0808 08:46:43.156032 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.156042 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.180502 (+ 24460us) server_negotiation.cc:407] Connection header received
0808 08:46:43.184038 (+ 3536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.184046 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.184157 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.184250 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.185657 (+ 1407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59192: BlockingRecv error: recv got EOF from 127.0.0.1:59192 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 08:46:43.189004 21531 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.176471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43808 (local address 127.19.242.252:43425)
0808 08:46:43.176791 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.176798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.183268 (+ 6470us) server_negotiation.cc:407] Connection header received
0808 08:46:43.187077 (+ 3809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.187092 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.187214 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.187307 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.188691 (+ 1384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43808: BlockingRecv error: recv got EOF from 127.0.0.1:43808 (error 108)
Metrics: {"server-negotiator.queue_time_us":135}
W20260808 08:46:43.192087 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.162031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51092 (local address 127.19.242.253:40577)
0808 08:46:43.162278 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.162285 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.182655 (+ 20370us) server_negotiation.cc:407] Connection header received
0808 08:46:43.189590 (+ 6935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.189599 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.189730 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.189815 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.191767 (+ 1952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51092: BlockingRecv error: recv got EOF from 127.0.0.1:51092 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260808 08:46:43.235761 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.226350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51096 (local address 127.19.242.253:40577)
0808 08:46:43.226577 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.226584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.233365 (+ 6781us) server_negotiation.cc:407] Connection header received
0808 08:46:43.233792 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.233800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.233966 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.234110 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.235357 (+ 1247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51096: BlockingRecv error: recv got EOF from 127.0.0.1:51096 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 08:46:43.263231 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.250340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51106 (local address 127.19.242.253:40577)
0808 08:46:43.250560 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.250566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.260588 (+ 10022us) server_negotiation.cc:407] Connection header received
0808 08:46:43.261299 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.261307 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.261429 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.261518 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.262966 (+ 1448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51106: BlockingRecv error: recv got EOF from 127.0.0.1:51106 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 08:46:43.307251 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.305040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51108 (local address 127.19.242.253:40577)
0808 08:46:43.305255 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.305262 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.305375 (+ 113us) server_negotiation.cc:407] Connection header received
0808 08:46:43.305737 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.305749 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.305877 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.306024 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.306972 (+ 948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51108: BlockingRecv error: recv got EOF from 127.0.0.1:51108 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260808 08:46:43.318853 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.316198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51122 (local address 127.19.242.253:40577)
0808 08:46:43.316486 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.316492 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.317130 (+ 638us) server_negotiation.cc:407] Connection header received
0808 08:46:43.317345 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.317351 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.317473 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.317583 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.318555 (+ 972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51122: BlockingRecv error: recv got EOF from 127.0.0.1:51122 (error 108)
Metrics: {"server-negotiator.queue_time_us":156}
W20260808 08:46:43.334038 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.331410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.19.242.253:40577)
0808 08:46:43.331619 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.331626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.332250 (+ 624us) server_negotiation.cc:407] Connection header received
0808 08:46:43.332491 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.332497 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.332623 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.332753 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.333699 (+ 946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51138: BlockingRecv error: recv got EOF from 127.0.0.1:51138 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 08:46:43.359236 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.356788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51144 (local address 127.19.242.253:40577)
0808 08:46:43.356998 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.357005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.357557 (+ 552us) server_negotiation.cc:407] Connection header received
0808 08:46:43.357768 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.357775 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.357887 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.358036 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.358952 (+ 916us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51144: BlockingRecv error: recv got EOF from 127.0.0.1:51144 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 08:46:43.398393 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.395825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51146 (local address 127.19.242.253:40577)
0808 08:46:43.396080 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.396088 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.396597 (+ 509us) server_negotiation.cc:407] Connection header received
0808 08:46:43.396761 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.396767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.396886 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.397041 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.398077 (+ 1036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51146: BlockingRecv error: recv got EOF from 127.0.0.1:51146 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
W20260808 08:46:43.469129 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.466356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.19.242.253:40577)
0808 08:46:43.466558 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.466563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.467069 (+ 506us) server_negotiation.cc:407] Connection header received
0808 08:46:43.467443 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.467448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.467562 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.467769 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.468887 (+ 1118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51158: BlockingRecv error: recv got EOF from 127.0.0.1:51158 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:46:43.555377 21549 catalog_manager.cc:1259] Loaded cluster ID: fe3fa549f43344c29e7a9185d8a38acf
I20260808 08:46:43.555487 21549 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: loading cluster ID for follower catalog manager: success
I20260808 08:46:43.558280 21549 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: acquiring CA information for follower catalog manager: success
I20260808 08:46:43.561172 21549 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 409f3e03f32045c486518c6f7ca73798: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 08:46:43.603952 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:46:43.601638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51164 (local address 127.19.242.253:40577)
0808 08:46:43.601925 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.601932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.602274 (+ 342us) server_negotiation.cc:407] Connection header received
0808 08:46:43.602575 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.602579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.602662 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.602825 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:46:43.603748 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51164: BlockingRecv error: recv got EOF from 127.0.0.1:51164 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
I20260808 08:46:43.628315 21574 catalog_manager.cc:1259] Loaded cluster ID: fe3fa549f43344c29e7a9185d8a38acf
I20260808 08:46:43.628429 21574 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: loading cluster ID for follower catalog manager: success
I20260808 08:46:43.631203 21574 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: acquiring CA information for follower catalog manager: success
I20260808 08:46:43.633371 21574 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6fd0d7f9b24141849b0721f51ceb70a7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:46:43.871313 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:43.865172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.19.242.253:40577)
0808 08:46:43.865430 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.865438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.865660 (+ 222us) server_negotiation.cc:407] Connection header received
0808 08:46:43.865839 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.865843 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.866011 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.866130 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:43.866654 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.867399 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.868808 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.869272 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.869379 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:43.869956 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:43.870554 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:43.870780 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:43.870903 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 08:46:43.870983 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260808 08:46:43.884615 21717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:43.878014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43814 (local address 127.19.242.252:43425)
0808 08:46:43.878510 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.878515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.878535 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:46:43.878769 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.878773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.878947 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.879157 (+ 210us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:43.879658 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.880497 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.881961 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.882447 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.882589 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:43.883312 (+ 723us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:43.883928 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:43.884050 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:43.884244 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 08:46:43.884321 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":274,"threads_started":1}
I20260808 08:46:43.903545 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:43.892095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51192 (local address 127.19.242.253:40577)
0808 08:46:43.892392 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.892400 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.896863 (+ 4463us) server_negotiation.cc:407] Connection header received
0808 08:46:43.897264 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.897272 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.897381 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.897480 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:43.898146 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.899114 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.901348 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.901858 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.902005 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:43.902591 (+ 586us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:43.902804 (+ 213us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:43.902909 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:43.903107 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 08:46:43.903224 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260808 08:46:43.904124 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:43.892076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59206 (local address 127.19.242.254:42131)
0808 08:46:43.896878 (+ 4802us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.896884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.896904 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:46:43.897040 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.897050 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.897332 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.897544 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:43.898562 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.899661 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.901404 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.902126 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.902281 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:43.903033 (+ 752us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:43.903507 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:43.903647 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:43.903757 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 08:46:43.903849 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4587,"thread_start_us":4484,"threads_started":1}
I20260808 08:46:43.904302 21717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:46:43.892076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43816 (local address 127.19.242.252:43425)
0808 08:46:43.892300 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:46:43.892306 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:46:43.897340 (+ 5034us) server_negotiation.cc:407] Connection header received
0808 08:46:43.897499 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:46:43.897507 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:46:43.897602 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:46:43.897712 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:46:43.898409 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.899557 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.901894 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:46:43.902546 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:46:43.902683 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:46:43.903295 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:46:43.903437 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:46:43.903504 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 08:46:43.903937 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 08:46:43.904032 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:46:43.910161 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21219
I20260808 08:46:43.911607 21308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:44.027937 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21219
I20260808 08:46:44.062415 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21323
I20260808 08:46:44.063773 21414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:44.175184 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21323
I20260808 08:46:44.205960 20427 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu pid 21433
I20260808 08:46:44.207422 21518 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:46:44.321144 20427 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskkvSB7S/build/asan/bin/kudu with pid 21433
2026-08-08T08:46:44Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5427 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (11124 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (406170 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST